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1973 Florida legislation requires each community 
college to evalifate the performance of former students in the 
activities for which' ithey were prepared by the^ college. This project 
developed and implemented a f6llow*u|> system for community college 
graduates in Associate in Arts programs. The system assessed- former 
students* achievement of the goals of the academic program for which 
they were prepared by the community college, in performance or 
competency*based terms. Specifically, the system should provide means 
for determining whether the goals of transfer programs, as^ defined by 
-the community colleges, are being realized. It should also provide 
data for improvement of thfe program and/or curriculum where 
necessary. The results of the implementation of this model indicates 
that it is a viable model that will be expanded at Hillsborough 
Community College to include other programs^ This model may also be 
adopted by other community colleges in Florida, and nationally. 
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The 1973 Florida StJlte^ Legislature passed Florida Statute 
230.7651, a law^that requ-^res each conmunity college in Florida 
to evaluate the p^formancV-of former students in the activities 
for which they were prepared by the college. The State Board of 
Education. Community College Division, has published guidelines 

.0 

^ie-assist coiranunityco.l leges in developing and carrying out the. 
intent of this Florida Statute and the subsequent Regulations of 
the State Board of Education (6A-8.581 (4)). 

' This major research project develops and implements a model 
•in keeping with the Florida Statute and State Department of . 
Education Guidelines. As a model for academic assessment of ti 
graduates, it used follow-up studies developed in performance or 



competency based terms. 



:,e model contains five components which involve conmunity 
college fagulty members and graduates as well as instructors in four- 
year colleges and universities. The five interrelated c(^ponents are: 
Ij defining program goals, 2) developing evaluation instruments, 
,3) collecting data, 4) evaluating data, and 5) deve^l^ping strategy, 
to introduce the data into the decision-making process. The emphasis 
was placed on the process used to develop these components. 

To implement the system, thirty r&ndomly selected graduat€i's^ 
yronwthree transfer prograrrts'at Hillsborough Community College w^e 
used. These programs were: Pre-Teaching, Pre-Business Admini^ration 
and Pre-Police Science. The University of South Florida was the only 
four-year college or' university represented due to the large number 
of Hillsborough Conmunity College graduates from these programs 
^^ho transfer to this university, ^ 

The questionnaires developed were then completed by ^^^^ 
graduates and theijr/university instructors. The results were 
tabulated and distributed to Hillsborough Community College faculty 
members for revision and; reconmenflat ions, A final report for each 
program was' prepared and distributed to the institutional decision 



na^ens for their action. 





The results' of /fne implenehtation of this model indicates 



thaVIt Is a y^^able model that will be expanded at- Hillsborough 
Community College to include other programs. This model may also 
be adppt|d by other communi^ty colleges in Florida, and nationally. 
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CHAPTER J ; . ^ 
/ . . INTRODUCTION . 

BackgrouhQ of Study 

The 1973 Florida %t,ate Legislature passed Florida Statute 
.(2,3(^.7651), a law that- requir^V each community college in Florida 
to evaluate the performance of former students in the" activities 
for which they were" prepared by the college. The State Board of 
Education, Community „ConegeJ3i vision* has published guidelines to 
assist conmun^ colleges in developing and carrying out the intent 

of the Florida Statute and the subsequent Regulations of the State 

« 

Board of Education (6A-8.581 (4)). - 

The state board of education guideline de^ne the methods of 

•* • 

program evaluation to be used as follow-up studies of former stu- 
dents, and identify the questionis to be answered in these follow- 
up studies as: 

1, How well is the attainment of the goals and 

J 

objectives of instructional programs reflected 

In. the performance of former students? ^ 

2, Do the requirements of the activities in which 
former students are engaging extend beyond the 
program goals and objectives? 



The state guidelines continue by describing a set of aciivities 
ilfh^ch should be performed In order to evaluate program effective- 
• ness. the activities are: ^ * * ' 

1. Identifying program qqals and objectives; 

2. ' Devising' .insti^uments and procedures for assessing: 

, a. the performance of former students iagainst the" • 
objectives, and 
b. the adequacy of the goals and objectives against 
the requirement^ of the activities in which former 
students are engaging; ' . 

3. Utilizing the instrument and procedures for making the 
above asse^ments of former students; 

4. Drawing cq^nclusions relative to the adequacy of program 
goals and objectives and make such chaing^s as are appro- 
priate. . 

Purpose of the Study . ' 

The purpose, of this t^esearch project was to develop and imple- 
ment a follow-up system for corrmunity college graduates in Associate 
in Art5 programs, the system assessed former students' achieve- 
ment of the goals of the academic program for which they were pre- 
pared by the community college, in performance or competen(|||^based 
terms. Specifically, this system sheuld provide means for deter- 
mining whether the goals of transfer programs, as^ defined by the 
conmunity colleges, are being realized. It should also provide 



data for Improvement of the program and/or curriculum. where neces- 
sary. ^ " . 

- While the Florida State Department of Education guidelines * 
describe In broad terms the procedure to be used to develop follow- 
up studies, no specific direction has been given to the Florida - 
comnunlty colleges! Institutions have not yet developed. methods . 
of collecting information from former students enrolled in transfer/- 
programs> Analyzing and evaluating ^hls performance or competenc^r 
based data, and using this information for |he purpose- of program . 
Itaprovement. Knoell and Medsker (1965) point out th&t if corrtnunity 
colleges do not prepare students to achieve ^heir baccalaur'eate 
degree goals at some acceptable level of performance, the effective- 
hess of commui^lty colleges *as a sub-system of higher education will 
be open to some serious questions. Another and equally Important 

reason for program evaluation through follow-up studies is the 
. I . .. ^ ■ ■ ■ . 

demand by -state legislators and the public at large to provide 

some degree of ^accountability for the outputs ^f educational 

programs. ' ; 

Cownunlty colleges have often evaluated the academic perfor- 
mance 6f form^ students In terms of grade point average, retenttim^^ 
and vocational success, thereby providing valuable Information regarding 
their programs (Knoell and Medsker, 1965). However, these studies 
do not meet the criteria to measure and evaluate Identifiable 
performance or competencies of program graduates. 



Kintzey (1973) stated that the rdtjuirement for four-year 
colleges or universities to totally accept an associate degree, : 
! or a course package certified by the^^ college system, 

will become coninonplafce\by the end of^his decade. Many states 
are already- mandating articulation procedures. However, there 
is little evidence that systematic procedures to allow studAts 
to move easily through \he higher^education system are keepilig 

Q 

pace with the increased transfers from community colleges^ to four- 
year colleges and universities (Kintzer, 1973), 

Florida provided an articulation agreementHsetween corrajiunity 
colleges and, statfe university systems in 1971. This agreement 
while stating that community college graduates must be accepted 

♦ 

by the state university system, does not provide for complete 
articulation of all courses. Therefore, access problems still 
exist and the degree of academic preparation is still being 
challenged. It was the purpdse of this fol Tow-up system to 
identify the specific areas that are being challenged in each 
acadeijiic program. 

The follow-up system developed in this project provided the 
framework for program evaluation In performance or competency 
based terms at Hlllsborougli Conmuhlty College. The system can ba 
used br other community colleges In Florida, and nationally, as thi 
basis for their system by adapting each component to their ad- 
ministrative and program structure. 
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All components of this system were developed in keeping with 
state guidelines (Florida Guidelines, 1^74), university structure, ^ 
Hinsborough Community College structure, and analysis of appropriate 
.literature on- information -systems development, wij-iting of performance 
and competency objectives, data collecting, articulation and* account- 
ability. 

• . — ' . . . i • ' ■ ■ • 

Definitions • . ' 

V For purposes of clarity, **the following definitions are used 

In this study: * . • 

Program Manager . Faculty members assigned by the academic 
A director to be responsibTe for a program have been given the title 
of program manager. ' . 

Program . A planned instructional sequence through which 
students can expect to develop the competencies required for entry 
into an identifiable activity is defined as a program (Florida . 
Guidelines, 1973); ' . . 

Director of Follow-up Studies . The administrator in charge 
of collecting data" for the purpose of evaluating Curriculum and/or 
programs, preparing state reports, and relating all data to the 
• Institutional decision makers has been given the title of Director 
of Follow-up Studies. 

Transfer Institution . A college or university offering 
bachelor or higher degrees to which community col lege graduates 
transfer is considered a transfer institution. 
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Graduates . Individuals who have completed the prescribed cur- 
riculum and have been awarded a degree by Hillsborough Coninunity 
College. This study includes graduates frpm^-January 1974t through 



June 1974,^^p-ji population from whichj^^p^Jlw a random sample. ^ 

PrxKiram Goals .' Goals defined by the program jnanagefs and 
faculty members tat t^g the competencies or skills to be achieved 
by a. student\CompljB^ing the prescribed curriculum. 

Criterion-Referjsnced Statements or Ques.tiong . Statements or 
questions relating directly to a fixed set of goals stated in per- 
formance or competency terms are criterion- fefe^^enced. 

Program accountability . As reflected in this project, is the 
term defined as performance, or competency evaluation of the per-:* 
formance, of program graduates in the area from which they received 
their degree: ./^ 't. 

Sources of Information or Assistance 

To complete this research project, both assistance and Infor- 
mation were needed by tlie Director of Follow-up from Hinsborough 
Community College faculty, students, graduates and administrators, 
as well as university students, faculty and administrators. The 
Hillsborough Comndunity College faculty developed the program goals, 
evaluated program goals aij^^tfiitruments, evaluated the data col- 
lected, and made recommendations for the use of this data.. 
Hillsborough Community College students reviewed Instruments for 
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vocabulary and readability. The community college graduates 

^ . V •• . ' 

completed the questionnaires identifying the four-year college 
or univer5.ity to whi ch 'they tr^sf erred. The administration pro- 
vided the necessary sypport system for the project and implementation^ 
of recoifBTiendations. The. registrar's office identified graduates 
by program* and provided the names * addr-esses and telephone numbers 
of these graduates. ' . 

The university faculty members were asked to assist in 
evaluating the instruments and in providing the information about ^ • 
the communitV college graduates.' The Univei^ity administrators 
were asked to assist in supporting the project and enlist^he aid . 
and support of the faculty members. , . / 

M , $ - ■ ' 

Organization of tli'^ Study ?v 

Chapter II reviews the literature on follow-up studies, 
articulation and accountability. This chapter identifies the 
lack of research on program accountability in performance of 
competency -ba s ed^tepms . 

y'Chapter III describes the methodology that was used" to initiate 
this project. In this chapter an outline of the system and the 
five components of the system ;is presented. 

Chapter IV is a presentation of the results of the pilot 
project and includes the' instruments developed, data collected 
and the' uses made of this data. This chapter also describes \ . 



the criteria u^ed and the success of each proc6dure.\ Suggestio 
are also made regarding the revlsio^n of the system and each 
component of the system. 

Chapter V presents a system that can^e adopted by ai!y - 
comnunity college in the United States-. This chapter- outlines 
the preliminapy questions to be §;«mi"ned by^an institution, and 
the procedures to be followed to implement a follow-up system 
in performance or" com^6tency-based terms. j^-. 

Chapter V also describes* the significance of this study. 
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f r \ CHAPTER II y ^ 



REVIEW OF\THE LJTERATURE ^ \^ 
This chapter reviews literature anji research, oa institutional 



and Instructional accountability in higher education, and the 
relationship of these topics to the need for a competency-based 
evaluatoWn system of community college graduates who transfer to 



Jnsti'tutions. 



' Accountability in Higher Education • \ * 

• Accountability is a term which* found increased use *ih educa- 
tional publication ^n the late 66's and 7p^.. Kingman Brewster, Jr., 
Preside;it of Yale. (1971 y. suggests that managerial accountability's P 
requiring that top administrat6rs beheld accountable" for overall |er- 
formanc^flf an Institution witj^in a specific time l^rame, Morjtimsr 
(1972) emphasises that accountabiillty of top admlnistrfrors must 
permeate the entire institution/and its programs if, the Institut^n 
Is to be made accountable for student learning. 

Durftig t^e islxtles, Cass (^9^0) questioned whether any ^ . 
institution that enjoys a vlr^al monopoly can remain sensitive 
%nd responsive to the changing^^eds of Its diverse clientele. 
To answer this challenge, Lessinger (1970) suggested that schools 
should be evaluated and educators held accountable for student 
achievement of specific, measurable outcomes of ^the educational 
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- process. Lessinger (1970) claifts that this evaluation of student 
achievement/ can be implemented successfully only if the educatio:;al 
objectives of an institution or program are clearly stated. 

Literature suggests th^t the relationship between accurate 
statements of expected outcomes,/ accountability and evaluation 



of programs provide an interrelated process. Specifically, Bloon 

■J " 

(1956) points out that goal statements provide a framework for 
viewing the educational processes and analyzing, its workings. 

The concept of accountability is based on defining the goals 

- of a program or Institution, developing measuring techni.ques to 

^- • . • ■ 

determfne if the goals are achieved, and evaluating the instructional 
methods tcf provide guarantees that most students will attain these 
goals. Accountability suggests* that educators assess how well 
students* are tfeing taught and use precise criteria to evaluate both 
teaching, and changes in student behavior. 

It Is important that the major goals of a college or program 
of Instruction be clearly identified if the^work of the instituti:n 
is to^be guided by some plan (Bloom, 1956). It is by the achieve- 
ment of these goals that educators can show that students have 
demonstrated evidence of behaviors that were impossible before \ 
teaching took place (Rouephe, et: al., Goal statements 

also assist teachers, administrators and research workers in 
currlcular development and evaluation, facilitate exchange of 
information about curricular developments and facilitate the develop- 
ment of evaluation procedures. 



Demand- for accountability by institutions of higher education 
are coming from many directions. The most vocal of these are 
state legislators, the executive branches of thjB government, and 
specific communities in which instnutions,.af^^ located. 

Therefore, to meet these legitimate demands, institutions of 
higher education must deve}op managerial, and eclucat^nal evaluation 
syjitems. Mortimer (1972) stresses that to develop an account- 
ability system cne must consider all segments of the institution 
This system must: assess the needs of the groups being served; 
describe the situational factors, such as economics, community 
growth and changing demands of society; and considers the 
institutional decision-making processes. All of these factors 
are essential in planning a program of/a>ction. 
* The question of who s^©thW be the decision makers must be 
viewed from the perspecttve^of determining the institutional level 
at which it is moft appropriatSi W decisions to-be made. An 
answer to the^ question, ''Who is accou)»iUble/to whom and for what?" 
becomes tied to' the prpper>=daties and responsibilities of eaclh 
internal comporient at each decision-making level of thp institution 
and the state goals of that component (Mortimer, 1972). It is 
these deci si orj makers who determine the nature and extent c# staff 
^develdlJinefitf needed to implement related activities, measure cost 
effectiveness, and analyze the results obtained, and they will be* 



held accountable for their decisions; ^ 

No matter what opinion of accountability one holds it is an 
idea whose time has. come (Browder, et. al., 1*73). /Account- 

ability is a powerful concept, a natural culminatioA of many 

)' *" ' / • • ' 

parallel activities already accepted, such as pljiiwed pirogram 
budgeting systems, management by objectives, institutional goal 
setting and evaluation of student p^rfoVTnarice of competencies. 
Browder, Atkifts and^^ays (1973) observe that a corrmitirtent to 
accountability is a necessary pfeconditioh to move public education 
to a neW and more effective level of performance and sophisticatit}n. 

Accountability is particularly applicable to "open door" two 
year colle^^es that serve a variety of studehts, from diverse ed- 
ucational backgrounds. These colleges are concerned with the out- 

. ■ ■ ■ * 
comes of learning rather than the qualifications of Students at 

the time of entry (Roueche, et. a>. , 1972). ISe idea of account 
ability in higher education is quite simple; Brower (1972) 
istates that colleges and universities are responsible for con-*^ 
ducting their affairs so that the educational outcomes are worth 
their cost. ■ Institutions should define goals and outcomes con- 
slstent with these goals, provide programs to achieve the goals 
at a minimum cost, and prove the entire system (Roueche, et. al., 1972) 

Accountability demands that educators change their attitudes, 
renew their creativity and respond to society's needs by 
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re-establisR:ng public confidence fn education (Roueche, etC al.v 
1972). This demand -is being enfoc^ed. by therein positions to 
make taws and provide the funds for educational institutions. 

- The Flbrida Legislature- has recently exerted its influence • 
•in the area of educational accountability by passing^legislation 
which fixed the number ofJwursV^at a conimuhity college te^icher 
must spend in the classrwm. They^have aU'o demanded t:hat communi 
colly's tvaluate their graduates, 'to assess how well they have •. 
achieved the goals of the program in which they were enrolled. 

The executlveibranch of government has also exerted, its ^ 
influence in the area of accountability. The ebvernor and Cabinet 
sitting as the State Board of Education in 1971 ,,iJ»(irfa ted a stxi4;e 
wide articulation agreement. This agreement provided the baste 
framework within which students who complete an appl^oved program 
at a coirtnunity college are assured of acceptance as a junior whejfi 
they transfer to a state university in Florida (GuideUnes, 1974). 
Therefore, accountability of community colleges, as defthed in 
this chapter becomes an ever increasing need if these public two^ 
year colleges are to achieve their.place in the Florida system of 
higher education. 

It Is therefore clear that the age of accountabili^Jn high 
education is upon us and that, thus far, the systems of evaluati^ 
which we have produced are not adequate to meet the demands df a 



■J , - ■ - ^ '. ' 

concerned public apd Its elected representatives (Garner, 1974)/ 

One iqethod' to enhance program and institution accountability 
Is to evaluate the graduates' achievement of success in reaching 
the program goals defined by the institution. This can be carried 
put by evaluating the, success of community college gra^kiates^ 
who transfer to four-year colleges and universities. 

Studies of Transfer Students : In the past decade, there have 
ken four natioTial projects that studied various aspects of transfe 
admission (Willingham, 1973): They are the Knoell-Medsker study pf 
student perf ormaince , 1964; Guidelines of the Joint Committee and 
Senior Col 1 eggs/ 1966; the "wiVlingham-Fihdikyan study, a survey ;^ 
of admission patterns, 1967; ai)d the Kintzer survey of articulation 
in 50 statesi 1972. In addition there have been minor studies 
on the articulation of transfer programs. . w 

Knoell-Medsker Study : As early as 1961 the importance of 
evaluating the performance of students who transfer from two- 
tq iFour-year institutions was realized. The Center for the Study' 
o| Higher Education at Bef-keley intiated a study that was done 
by Dorothy Knoell and Lei and Medsker. The Knoell-Medsker study, 
using 7,243 junior college students who transfered in ^960 to 
43 senior institutions and 3,439 students who entered four- 
year Institutions as freljfcen, compared performance of transfer 
students to native studenfr. This first comprehensiv^ational 



«0 



stu4y/of student transfers from two-year colleges to four-year 
Institutions was a landmark study and served| as a basis for the 
development of articulation guidelines in 'a nomber of states. 

The Knoell-Medsker study descHbed the characteristics that 
influenced the success of community college graduates in four- 
year institutions. The characteristics were the four-year college 
they choose to attend, demands made on them by community college 
Instructors, and the financial assistance made available to them 
at tiie transfer institution. ' 

•In considering the characteristics of the four-year College 
chosen by junior college graduates, it became apparent that four-, 
year institutions needed to examine their policies and procedures 
regarding transfer students. Knoell-Medsker specifically identified 
the need for four-year colleges to make space available for transfer 
students, to assist two-year college tt-ansfer students in overcoming 
financial problems, to improve counseling services, to provide' 
orientation programs for transfer students, to Consider developing 
entirely new programs to accomodate junior college graduates, and 
to develop curriculum master plans to mee^ the need^>of these 
students. 

The. results of this study by Knoell and Medsker (1965) 
Indicate'that itini or coll e^ were making it possible for 



high school graduates to begin work on a baccalaureate decree # and 
that most junior college students could be successful in achieving 
.their degree goals. . 

In terms of these findings <it is apparent that junior colleges, 
need to conduct follow-up studies of their students to learn more 
about the problems they have encountered after transfer and to 

prepare students to meet these problems (Watteriberger, 1966)- 

' , • , %v . 

Mhiildf.the Knoell-Medsker study made recommendations to four- 
year colleges -and universities regarding transfer students it^ 
neglected the area of competency or Vei^f'o^nance level evaluatfon 
appropriate for the educational programs from which the transfer 

student came. 

• • * • ' . 

Guidelines of the. Joint Committee : The Guidelines of the 

r- 

Joint Committee (1966) were developed as a result of the Knoell- 
Medsker study. These Guidelines were developed and revised 
through participation by individuals from both Junior and 
senior colleges^ thereby providing two way communication. The 
document provides assistance to junior and senior colleges in 
improving articulation and is organized under five headings: 
Adknission, Evaluation of Transfer Courses, Curriculum Planning, 
Counseling and other Student ^Programs and Articula^tion Programs. 
Although' policy recommendations were made regarding curriculum . ' 
evaluation* no direction was given for the collecting of data 
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specifically regarding the academic performance or competencies 
of community college graduates. 

The Willingham-Findikyan Survey of Admission Patterns : In 
1967, the College Entrance Examination Board conducted a survey 
to identify the movement of transfer students from two-year colleges 
into four-year colleges. This study found that junior college 
Students received a favorable acceptance rate at most""four-year 
colleges, although conditions va.^'ed aclros^s the United states. 
In evaluating acceptance, the access problems that existed 
nationally were identified as: shortage of financial aid, lack 
of available space for transfer students, and insufficient effort 
by four-year institutions to meet the unique needs of , transfer 
students. 

Using retention at the four-year institutions as a criterion, 
this study supported the belief that junior colleges are meeting 
their objectives as part of higher education systems. While 
Identifying access problems, the study did not evaluate academic 
preparation of transfer students In performance or competency- ^ 
based terms nor did it suggest that lack^ of academic preparation 
migfit be a major cause for non-acceptance, or lack of retention. 



Kintzer Survey of Articulation : The Kintzer Study of 
Articulation in 50 states was a national pilot survey completed 
in the fall of 1970. This study described increasing numberis of 
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procedures. Identified special problems, and- evaluated the philosophy 
of articulation in various states (Kintzer, 1973). Kintzer con- 

■ . - ' ' ' 

eluded that, since the Knoell-Medsker study of 1965, there had been 
little progress in the development of articulation agreements, and 
he argued for rapid development of statewide plans for articulation. 
If one accepts Will ingham's (1972) philosophy that a major function 
of community colleges is to provide the first two years of a 
baccalaureate degree program, it is' self evident that programs at 
the two levels must be articulated to avoid ll^s of mobility of 
students. ' ^ \ . 

In the publication. State Master Plans for Community Colleges , 
1969, Hulburt analyzed nineteen statewide plans for higher, education 
and noted that, even though studies done nine years before indicated 
a need to re-evaluate transfer policies and procedures,' there was 
a total absence of such accomplishments. While Hulburt makes a 
case of examining transfer policies and procedures, he does not 
outline the need for evaluating the quality of academic preparation 
provided by community colleges. 

Competency-Based Education 

Although tlhe literature abounds with data and recommendations 
concerning transfer students, there is a singularly unique'lack 
of information pertaining to competency-based, evaluations of the 
success of c()mmunity college students who transfer to a four-year 



college or university which can be used as the basis for' academic 

X ■ ' ■ ' ■ ■ ■ ■•i'' / • ' 

decision-making (Articulation Study Report, 1973). ItSfs Important 

fn th^ improvement of guidance for those community college students 

Intending to transfer ^o four-year colleges or ;yniversit1es, to 

develop systems for the evaluation of community college progl^ams 

■ ■ . ^ ■ 'J ■ 

in performance or competency-based terms. One method of achieving 

this Is to use follow-up studies which are designed to provide 

feedback in performance or competency-based terms on the graduates 

of these programs. These studies' would complement Information 

now available regarding the number of transfer students who 

complete their baccalaurate dfegree (Will Ingham, 1972). 

• The need for follow-up studies to contain input from local 

colleges is expressed by Knoell and Medsker (1964). They point 

put that one cannot make valid assessments' concerning performance 

•f students. Independent of the context of the college in Which 

they were enrolled. Institutions to which they transferred,, and 

state systems of which they are a part. 

In developing a competency-based follow-up system fqr 

community college graduates of Associate in Arts programs, the 

writer used the theory of participating management. If classroom 

teachers are part of the development of the system,, they' will 

have a greater commitment to implement the results of this system 

which evaluates program graduates success. 'A model for such 

IP 

participating management is defined by Richardson, Blocker 
and Bender (1972) who advocate keeping hierarchial levels 



to a mfnimum and continually encouraging communication, problem 
Identification and consensus solutions. 



Summary 




Accountability, is a term that 'has gained increased use in 
the 60's and 70's to describe an educational evaluation process. 
The process of implementation oiF educatiofial accountability requires 
the establishment of measXirable educational goals and evaluation 
of these goals. There are many ways this may be accompli shed. and 
follow-up studies of graduates in performance or competency-based 
terms is one method. 

Follow-up studies have been done nationally examining various 
aspects of transfer admission, and retention of transfer studen^ 
at four-year colleges. Howeverrwhile problems of access have been 
evaluated the academic preparation of transfer students in per- 
formance or competency terms has not been evaluated. As the number 
of community college transfer students increase, the importance of 
program evaluation grows. Therefore, the process developed in 
this research project is important as a step towards establish- 
ment of a model that could be used on a nationwide basis. 




CHAPTER III ^ 
- '- * METHODOLfiGY 
Introduction . 

The Florida -State Guidelines , for implementation of follow-up 
studies required by the Florida Statutes. S230. 7651 and regulation 
of the State Board of Education 6A-8.581(4) are defined in broad 
teirms, allowing .each of the 28 community colleges in Florida to 
design their own methods* for collecting the required data. The 
guidelines describe the following steps to be taken: 

1) Identify program go^ls and objectives; 
. 2) Devise instruments and procedures for assessing: - 

a) The performance of former students against the objectives; 
and 

b) The adequacy of the goals and objectives against the 
requirements of the activities in which former students 
are engaged; 

3) Utilize the instruments and procedures for making the above 
assessment of former students; 

4) Draw conclusions relative to the adequacy\of the 'program 
goals and objectives^ making, such changes as are appropriate; 
and . ^ 

5) Draw conclusions relative to the effectiveness/ of the 
several components of the programs, including support programs 
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In^meetlng goals and objectives and making such changes 

as are appropriate (Guidelines, 1974)* 
This chapter will describe the methodology for developing and 
implementing a system for the follow-up of graduates in which 
performance or competency-basqd criteria are used to assess the 
achievement of program objectives.'. This system was Implemented 
using graduates from three transfer programs, Pre-Business 
Administration, Pre-Ppllce Science and Pre-T^achlng at Hillsborough 
Communfty College. \ 

In order to understand the framework on which thls^fiystem was 
built, some of the history, and the administrative structure of 
Hillsborough Community College are described. "I^is description will 
also Include a narrative on each program in relation to the Hillsborough 
Community College multi-campus structure. 

Hi 1 1 sborouqh Cbmnun i ty Col 1 ege *- 

Hillsborough Comnunity College, one of 28 Florida community 

colleges was opened in 1968. The college has grown from 1,625 ' 

students and a faculty and staff of 17 to an enrollment of over 

8,000 students and a faculty and administrative staff of 191 in 1574, 

One of the purposes of Hillsborough Community College, as 

stited in the 1974 revision of the college bulletin "is to offer. 

courses and programs of general and academic education parallel 

■V ■. ' ' « 

to those of the first and ^second years of work in iijstitutions of 

the state university system" (Hillsborough Comnunity College Bulletin, 

1974 p. 18). 
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the college Is located In four geographic, areas and for , 
the^l^ppse of adniinistrat1on>def jn^d as three ^campuses. The - 
admlnlstlratlcin of each campus Is under the direction of a campus 
d1 rector ,^ha represents his camfnis on the President's Council, 
an adv1soi|| board to the Presiden't, 

^ Thls^fdvisoryv board to the president. Is composed ofr tjbe 



exqgutlve^^ce^ administrative assistant to the President, 

vit^.t^presijdlent for" auxiliary services, vice-president for business 
ser^ce^,^ ^6r^e campus directors, two representatives of the faculty, 
one fepre^ntatlve of the career personnel and one representative 
of the stu«fnt'?|)ody. Matters of curriculum, as well as policy and 
projcedure^ aipB' evaluated by the President's Council and recom- 
mendatiofis^ are ^forwarded to the President for his action, 
^^All ;tut5jr1culum and/or program revisions, additions and de- 



letions ai^^l^tomniended to thie President's Council by the Academic 
|ij^<a1rs CmfnclK This council is composed of five, administrators 
'and five faculty representatives, with ^11 campuses represented. 



as ^ff^ned in the collective bargaining agreement of 1974. 

Evaluation of the success of Hillsborough Community' College 
In achieving its goal of providing academic programs parallel to 
those of the first and second yeafs of work in instilutions^of the 
state university system was the purpose of this research project. 
The method of evaluation was to assess relevant perceptions o1 
graduates from transfer programs regarding their preparatibr 
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their observations of 
a used €6 identify 



for advanced study as well as perceptions of selectedS'nstructors 
the four-year colleges and universities of the atl[afnment of specific 
comnwnity college goals, perceptions der.iVed from 
transfer students • 

Programs selected for the study : The criter 
programs to be studied were: 1) sufficient numbeif of graduates to 
allow sampling pf graduates, 2) programs with dijtinct core Courses, 
and 3) programs in which the program managers indicated an interest 
In participating in the pilot project. The three programs chosen 
were: Pre-Teaching, Pre-Business Administration,) and Pre-Police 
Science. ^ / 

• The Pre-Teaiching program parallels the Liberal Arts program 
with the exception of two courses. These two courses are Introduction 
to Education and Educational Psychology. While Educational Psychology 
Is sometimes taught bt^: full-time faculty members. Introduction to 
Education is always taught by part-time faculty members. This pro- 
gram is offered on all three campuses. No attempt is made .in any 
of the general education courses required by this curriculum to 
identify pre-teaching students or to adapt the core coursesjto the 
particular rifeeds of the pre-teaching students. 

JhB Pre-Business Administration program is primarily concen- 
trated at the Ybor City Campus. Courses in this area are offered 
on all campUjses, but they are not sufficiently spaced tliroughout 
the day and are taught by part-time faculty in many cases. The 
full-time faculty members in the core area include five at Ybpr 
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City Campus, two at Dale Mabry^'Campus and one at the Plant City 
Campus. 

The Pre-Pollce Science program Is taught only at the Ybor 
Campus, an* five full-time faculty members are teaching the core 
courses. 

The System : The five Interrelated canponents of the system a 
defining program goals, developing the questionnaires, collecting 
data, evaluating data, and introducing data Into the decision- 
making process. 

These five interrelated components were developed t9 allow 
revision at each $tep and to continue to Irjcrease participation 
by more members of the Institution of higher education at each 
step. To be successful at curriculum and^ir program revision,^ 
the faculty must be convinced of the necessity of these changes. 
If faculty mambers are to react, adequate data must be collected 
from graduates and foiir-year college and university Instructors. 
Therefore, this system is a participating management system. 

This system Included collection and analysis of Information 
required to meet state guidelines for follow-up study, as well 
ais, pirovfslons folr showing Infohnatton to the Institution decision 
makers regarding curriculum and/or programs. The system and its 
components were designed to be used with modifications by other 
comrounlty colleges in Florida and nationally. 
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Component One - Defining Program Goals 

The Florida Department of ."Educ|ition, Community ColTege Division 
Guildelines (1974), define a program as a course of study leading 
to a degree, certificate or diploma. These guidelines further 
define program goals as competency or performance based statements 
regarding the academic course of study «fesigned,by a community collegfe 
to meet the requirements for a degree, certificate or diploma. 
In defining program goals, the guidelines outline that they must be . 
statements regarding the performance competencies achieyed by 
students completing a course of study. Using these definitions and 
the programs as identified in the Hillsborough Community /Col lege , . 
catalog, the process of defining of program goals was begun. 

At the request of the writer (the Director of Follow-up), the 
campus directors appointed program managers for all programs of- 
fered on all campuses. Each program manager was responsible for 
defining the program goals in performance or competency 
assisting the Director of Follow-up in developing instruments, 
analyzing and evaluating the data collected, and in helping in the 
preparation of state reports and in the making of recommendations 
to the admi ni str ator regard ing program and/or curri cul tjm_ reyis i pns . _ _ 

An Informal meeting was scheduled by the Director of Follow-up 
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with each program manager. The purposes of this m^eting^was to- 
explain to the program manager the state system^to request, that 
he or she wrfte program goals for the programs ; to describe the -^ 
proposed f 0^1 ow-up system^and to obtain their suggfestlons regarding 
this follow-up systeift. . . * ' \ ^ 

. The Director of Follow-up also used these Infomvsl fneett^gs to 

Identify the 'pr:dgram$ that would be used In the Initial istudy. The 

' ' ' ■ ■ • . ' t- ■■ ' " ' ■ ' 

criteria used were (1) Interest shown by program managers In parti- 

cipating, {2), sufficient nuh||er of 0973-74 graduates from which 

to obtain a sample ^nd (3), programs^ with 'different tore courses. 

The programs identified at Hnisbbrbugh 'Conniunlty College using 

these* criteria. were; Pre-Teach1ng\ Pre-Buslness Admlnistr^itlon 

arid Pre-Pol ice Science. 

When the [irogi^am goals were rece.1 veil from these program managers 

of these three progrjims they were: compared' to institutional goals 

. ■ * ■> ' ■ * ' , • ■ . 

and the requirements of the program as listed, in the catalog; reviewed 

, , * . ' ' ^ * 

to determine whether they were in competency-based terms; coordinated 
In the caise of^multl^^campus programs; and. returned to each program. 

nanager for consensus. When consensus was reached, the program goals 

- ' . ' • ' ■ • ,/ ■ • 

iMre preser^ted to the Academic Affairs Council for its evaluatioh, 

. - • ^ 

reaction and information. • These program goals were then' used as 

". - • . • . • * , . * ' - 

the basi^ foi^ the competency or perforinance based questions on the 

questionnaires. No Judgments as^ to the relevancy of these goals 

In relation to each program was made by the Director, The built- 



in, self-correcting, mechanism of this system would assist in 

% 

validating the program goals- as originally clefined. 

Component Two - Developing the Questionnaires , 

There wer^ two questionnaires to be developed: one tp be sent 
'to thirty randomly^'i selected graduates of each program and the second 
tojbe sent to the graduates' instructors at the four-year institutions! 
The graduate questionnaire corttained three distinct sections: 
descriptive questions, criteria-reference questions and open-ended 
evaluation questions. The Instructors' questionnaire only contained 
two sections: criteria-referenced questions and opeji ended evaluation 
questions. Similar questions were used on both questionnaires for 
the criterion-referenced questions while the open questions v/ere 
related to the specific strengths and weakness of the program as 
perceived by the graduates and instructors. 

The first draft of the graduate. questionnaires were, prepared by 
the Director of Follow-up.. These <irafts were: sent early in the 
Fall of 1974 to the seven program managers identified by the campus ] 
directors; to twenty faculty members ideintified by program managers*, 
and to the school psychometrist. Jhey were asked to review the 
questions, format, and descriptive data, requested on the question- 
naire and to return the questionnaire with all recotFinendations within 
two weeks. Osing^^the suggestions for revisions received, the Director 
revised the questionnaires and returned^^ the final draft to the prograiji 
managers and faculty members for consensus (pps. 44-58).° 



The revised graduate questionnaire was then administered by 
' the^ program managers to second-year classes of approximately 
thirty students In each program. When students in these classes 



had complete the questionnaire, the program manager discussed 
the questionnaire with them to evaluate vocabulary and format. 
Any revisions' necessary were then. Incorporated Into the final 
questionnaire. 

The questionnaire was mailed -In late November 1974 to thirty 
graduates from each program chosen by use of a random number table. 



The graduates In this sample were from the student population who 



^ The questionnaire for the Instructors at the four-year colleges 
and universities was designed by the Director of Follow-up using 
the same format for the criterion referenced questions, and open- 
ended questions. -This questionnaire was reviewed by program managers 
faculty members, and the school psychometrlst. Their comments and 
suggestions were Incorporated Into the Instrument. This draft 
was then used at the initial meetings with university personnel to 
describe the system and data r*equ1red. The Director of Follow-up 
made an appointment with the deans and department chairmen at the 
University and explained the research project, the state guidelines 
and the Information that was requfred by the corranunity college to 
complete the state reports. The department chairmen, or deans, 
then butlined the methodology they considered easiest to obtain 
data from the Instructors in their department/ 
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graduated between January, 1974 and June, 1974. 
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Component Three - Conecting of Data . ■ 

Thirty- five students from each^ program, who graduated between 
January, 1974, and June, 197,4, were identified using a table of 
random numbers (Owen, 1962). The programs used, as previously 
Indicated, were the Pre-Police Science, Pre-Business Administration, 
and Pre-Teaching at Hillsborough Community College, Tampa, Florida. 
A first' mailing was done using the first thirty graduates identified. 
As any questionnaires were returned as- undeliverable by the post- 
office, the next nimber was used to replace this graduate. 

The method of collecting the data was' a mail questionnaire. 
A mall questionnaire was chosen because it provides a method of 
collecting data at a minimum of expenses in money and effort; 
allows for wider geographic contact; reaches people who are 
difficult to locate and interview; permits more considered answers 
from respondents and greater uniformity in the manner in which 
the questions are posed (Wallace, 1954). 

Techniques to increase the percentage returns of mail 
questionnaires identified by Wallace were utilized.. The- techniques 
are appealing to the concern of others, developing a personalize: 
Introductory letter, enclosing a stamped 'envelope, telephoning 
respondents who do not respond, and mailing a second and third 
questionnaire. 
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Each graduate was mailed an individualized letter requesting 
cbmpletion of the questionnaire (Appendix A) and a self-addressed 
stamped envelope in which to return the questionnaire. If the 
questionnaire was not returned in' ten days, a telephone call was 
made to the graduate requesting that the questionnaire be completed. 
A second mailing was done three weeks .after the first, followed by 
a third mailing two weeks later. Records were kept regarding the 
percentage of returns achieved by. each methocl. 

Using the data from the graduate qCiestionnSiire, each collecej 
that the graduates were attending was" identified. For the purpose 
of this study, no four-year college "or university outside Florida 

' ■■ 

was used and only the four-year colleges or universities attended 
by 10 percent or more of the graduates were included. 

When the four-year colleges or universities were identified, 
the courses in which the Hillsborough Community College graduates 
were enrolled during the winter term were identified, us^ng the 
college locator. Th6 college locator is a computerized listing 
of the courses in which each student is presently enrolled. The 
Instructor of each course was identified by using department files. 

The questionnaires for the instructors in the foiir-year 
institutions were mailed in the sixth week of an eleven week 
quarter. A personalized letter (Appendix B) describing this 
pi'oject as a method of implementing state law and. Board of Education 
regulations and a self -addressed stamped envelope were sent with 
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the questionnaire. If an answer was not received byHhe end of 
the winter quarter, ^a second request was mailed at the beginning 
of the spring ^enn, followed by a third two weeks later. 

Combonent Four - Evaluation of Data ' ' 

Two sets of data were analyzed, the data received from the 

r • ' ' ' 

graduates and the data received from the Instructors at the four- 
.year colleges and universities. The data collected from the tqtal 
graduate population In each program were compiled. This analysis ^. 
contained three parts: descriptions of graduates' present status » 
graphical representation of criterion-referenced qi|pst1pns, and 
sumnary of open-endfed questions." The analysis of graduate data 
from each program was sent edrly In the winter term to both the 
program managers and those faculty members Identified by the 
program managers. These Individuals were requested to review 
this data for the purpose of curriculum/program revision and to 
Identify any other f^aculty member Who should receive the Information. 
Responses' were requested by the Director of Follpw-up within two 
weeks. If a response was not received within this time frame» a 
telephone call was. made to the Individual* followed by an Informal 
note requesting Inmedlate return of the Information. 
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The data received from' the instructors at the four-year 
colleges and universities wert analyzed. The responses to the 
criterion-referenced questions were represented graphically and a 
summary of open-^nded questions was presented. An analysis of this 
data was requested by the Director of Follow-up within two weeks. 

Finally, using all the data collected, a final report was 
forwarded to the program managers of each program and faculty members 
Identified by the; program managers. These individuals were i^e- 
quested to review the data for the purpose of making reconinendations 
and revisions to the questionnaire? or goals, evaluating program , 
and/or curriculum revisions that should be implemented and answering 
the questions required by the state, which are: 

1) What findings or conclusions result from the follow- 
up evaluation of students who completed the program? 

2) In analyzing the findings or conclusions, what changes* 
are being considered and/or have been made in the 
expected outcomes of the programs? 

3) In analyzing the findings or conclusions, what changes 
ar^ being considered and/or have been made in^the design 
and Implementation of the instructional support components 
of the program? . . 

4) Are there requirements of law or regulation external to 
the college which inhibit needed program njodifications? 
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■Component Five: Introducing Data^lnto the Decision-Making Process 

AlVof the Information collected from the Hinsborough Community 
College faculty, graduates and the Instructors at the four-year 
colleges' or universities was analyzed and a total report was pre- 
pared for each program. These reports were sent to the program 
managers, faculty member, counselors, and Instructional resource 
faculty, campus directors and Director of Instruction. Those 
automatically sent the reports' Included the Academic Affairs Council, 
the University of South F]^or1da, Hillsborough County Board of Public 
Instruction and Hillsborough Qonmunity College Coordinating Conmlttee 
plus t^^e College's Planned Program Budgeting Committee.. An article 
outl1n1na,,the pn)ject, listing the reports avx^tUble and\expla1n1ng 
how to obtain a report, also appeared In the official Institutional . 
newsletter. 
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CHAPTERIV. / ' ^ 

IMPLEMENTATION AND APPRMSAL OF THE SYSTEM 

This chapter describes the processes and products of the follow-* 
up system developed to assess student's and Instructors' perception 
of the degree of attainment of objectives of community college 
gradi/ates who transfer to four-year colleges and universities. To 
establish the criteria for such assessments, perfonnance or competency- 
based objectives were used. The resulting^ system 1s^ composed of five 
components and the processes and products of each component are 

presented. t 

• , ■* ,' ■ ' 

The Sys ten Takes Shape c , ^""^ 

The success of the entire system depended on the establishment 
of a participatory coninuntcatlons network. Participants In this 
network Included: community college faculty members^ graduates 
from community college programs. Instructors' at the four-year 
colleges and universities and the declslon^makers In the community 
college. The facilitator of this communications network In this 
study was the Director of Fol]ow-up. 

In developing this communications system with. community 
college and four-year college and university staff iheijibers, formal, 
as well as Informal, m^ethods were used. These methods consisted of 
memoranda, meeiitngs, written reports, telephone calls, luncheons 
and Informal discussions. The contacts with graduates were. In 
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all cases, through formal letters. (Appendix. A) ^ 

^ The initial corntiunications network was comprised of all the 
program managers and was expanded td Include those Hillsborough 
Community College faculty members , who had been Identified by the 
program managers Or who had expressed interesrt in participating in 
the project, A random sample of graduates from the Pre-Police Science 
Pre-B'usinjsss Administration and Pre-Teaching programs at Hillsborough 
Community Col lege was identified to participate. Also, the ad- 
ministrative heads of the departments at the University of South 
Florida and the instructors in these departments who taught 
-Hillsborough Coimiunity College graduates were included. 

It should be remembered that utilizing the established criteria 
for identifying four-year colleges and universities indicated that 
83 percent of the graduates presently attending a university were 
registered at the University of South Florida. Thus, only the 
University of South Florida was included in this study. 

The processes in each program were described as to the extent 
of involving all participants in the system. However, the extent 
of Involvement of community college program managers and faculty 
members in developing the questionnaires and using the data col- 
lected for decision making were the most important evaluative 
criteria. ^ 

This chapter reviews the Initial goals, the questionnaires, used 
data collected and a description of the use of this data in the 

decision-making process. Suggestions for revision of the system 

■ . ' ■ ■ ■ 

are included. 



The revised goals and questionnaires developed througH liji- 
pTe^ientation of this system are discussed In this /chapter and pi^e- 
Sfented In the appendices^>-^^ y 



Component One Developing Program goals ' 

• \ ■■ . 

The f re-Teaching program manager| from all campuses submitted 

• ' " ■ • ' *, ^ * 

a complete set of program goals to the Direi^tor of Follow-up. The 
Director then combined statements frotn ^ach campus* translitlng^hem 
Into performance or competency-based |a|fguage> and returning the 
drafts to all program managers for cohs^nsus; \When consensus was 
reached, these goals were used as the basis for developing the follow- 
up questionnaires. - There were eight goals for Pre-Teaching. 

. Tabl e 1 

Hillsborough Communi^^ College - 1974 
Pre-TeachingiProgram Goals 

- ■ ' ■ ■ I 

The graduates of the Pre-Tea|hing Program will be able to: 

1. Demonstrate ability to communicate effectively, both In writing 
and In speaking. 

2. Demonstrate critlcisirand logical thinking In evaluating given 
Information. 

3. Demonstrate basic mathematical skills by solving problems and 
interpreting graphical data. 

4. Identify the effects of ethnic culture on Individual development, 
from both historic and present-day views, and demonstrate this 
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/ Hillsborough Community College - 1974 
Pre-Teaching Program Goals - Continued 

■ *• 

; by improving interpersonal relations* 
5/ Dev'eK^ his or her own value system regarding art and art 

forrnis and ^^monstrate this by attending chosen presentations. 
6. Relate daily political, social, and econom4c events to patterns 

of past historical incidents for the purpose of making personal 

life decisions. 

?• Interpret scientific facts and their implications to future 
human development and^ demonstrate this by making personal and 
^ economic decisions, using these facts.; 

y 8. Better understand themselves and demonstrate this by establish- 
,4flgVersonal goals, improving interpersonal relationships and 
'^^^ accepting ^ ^ from different cultures. 

The Pre-Business Administration program managers from all 
campuses submitted complete sets of program -goal s to the Director 
of Follow-up. The Director then combined statements from each 
campus, translating, them into performance or competency-based 
language, and returned the drafts to all program managers for 
' consensus. When consensus was reached, these goals were used as 
the basis for developing the follow-up questionnaires. There 
were twelve goals for Pre-Business Administration. 
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Table 2 ^ 

Hillsborough CommLlhity College 
Pre-Business Administration Program Goals 

The graduates from the Pre-Business Administration program will 
be able to: 

1. Demonstrate ability to communicate effectively in writing. 
2/ Use mathematical formulas and interpret data related to 
business^ 

3. Apply statistical methodology to basic business probt ems. 

4. Identify the effect of culture on individual deyeldpfnent from 
both historic and present-day views. 

5. Interpret scientific facts and the implications of 'the role 
of scientific data future personal and human development. 

6. Evaluate the use of data processing systems in business and 
demonstrate by presenting adequate information to a computer 
programmer to facilitate the solving of standard business 
accounting problems. 

7. Evaluate national economics in relation to banking systems, 
international trade and governmental policies. 

8. Display good management policies by relating individual 
management objectives to company goals. 

9. Understand the theory and logic of good accounting pro- 
cedures and demonstrate this by properly recording business 
transactions. 

51 
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' i ' ■ / ^ 

Pre-Business ^^^$-^tfation Program GoaT^,C6nt1nued 

10* Implement an accounting System for a small ^business of 10 mil-, 
lion dol 1 airs "^or less per year gross revenue or a standard 
accounting system for a branch office of a larger business* 

W. Demonstrate managerial control In an accounting system by 
Implementing cost analysis to products and services. 

12. Analyze V^irodiySt and factor market to determine pricing. 

The Pre-PoHce Science program manager consulted with the 
thE g fek^^ members of the department and defined the program 
gpaTP^^^he core" courses only, asking the Dirtector of Follow-up 
to add the necessary general education goals. There were eleven 
goals developed for the Pre-Police Science program. 

Table 3 

Hillsborough Community College 
Pre-Police Science Program Goals 

The graduate from the Pre*-Po^j^;ce^Science Program will be able 
to: • ' • . 

!• Demonstrate ability *to communicate effectively, both in writing 
and 'In speaking, using the vocabulary and style necessary in 
police work. 
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/ Table 3 ^ 

Hinsbo rough Commuaity College 
Pre-Police Science Program Goals Continued 

V * ■ 

0 

2. Demonstrate basic mathematical skills in problem solving and in 
Interpretation of ^ data. ' . 

3. Identify the effecV^of culture on individual development from * 
both a historic and p/esent day view and relate this information 
to dally police work. 

4. ' Utilize his/her knowledge of criminal justice agencies and the 

court system in solving daily problems in police work. 

5. Apply the scientific method in the- coll ecf ion. Identification 
and presentation of the evidence in a police investigation. 

6. Develop a better understanding of self and demonstrate this; . 

through .Improving Interpersonal relations and acceptance of 

indlvlduar differences. . ^ 

- • » ' ' ' > , ' ■ 

7. Demonstrate understanding of.U.S. Supreme Courts decisions 

t^latlng to the'overali operation of the law enforcement 

• ■ . ■ ' ■ ' ' • ■ . 

agencies. ^ 

8. ' Conduct an iavestigation and demonstrate this \by preparing 

accurate notes, sketche^ and reports. .% / 

9. Demonstrate an understanding of the role, management and 
operational functions and facilities of a police department. 
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Hillsborough CommunUy College 
. pre-Pol ice Science Prc^ram Goals Continued. 

10. Describis t^^e baslc'capabilities ami services that may be pfo- 
vided by a crime' laboratory, • ' , , > ■ ' 4^ 

11. Describe managerial and adm^iStrMfve principles involved j ^ 
fn traffic law enforcement and education. ° . • . ' " 

.. The program managers in ajl three". programs were able to,.' - 
Identify the goals of their program in perfomrarice or'competen£y- 
based terms. * Agreements were' reached by the prbgramlnana'aers on r 
each campus In, tHe multl -campus programs.V The weakness b-f this 
component was evident pr imiri ly i n t(ie -Pi-e-Teachi tjg^ snd- Pre- 
Business Administration programs , were the .procfram managers; tended , 
to work in isolation when writijjg program goals. /This weakness^^ 
was remedied later when other faculty men^bers were, included, in ^ 
the system, but the system would have functioned -more effectively 
if more faculty members had been included, at the first step. 

After the first responses were' receiyied.frojtt the graduates and 
university instructors, faculty members and program managers 
suggested that, when writing all ,prbgranf goals, such goats be rank- 
ordered for easier evaluation of the data. This was done in the 
revisions for the following year. . (Apperidix C) 
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Component two; Developing the Questionnaire 

Hillsborough Community College Graduates > The draft question 
naires for all three programs, consVTting of descriptive data 
regarding the graduate, criterion-referenced questions, and open- 
ended questionsy, was prepared by the Director of Follow-up, The 
program goals were used in preparing this performance or competency 
based referenced questions. The open-ended questions allowed 

students to define courses of special value and to describe the 

. / 

specific strengths and weakness of the program. 

These questionnaires were sent to all program managers as 
well as to the six faculty members in Pre-Teaching, the four 
faculty members in Pre-Business Administration, and three faculty 
members in Pre-Police Science who were included in the system at 
this step. After review, the program managejps and faculty members 
reconmended minor changes in vocabulary^nd the. first drafts then 
were accepted. 
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HILLSBOROUGH COMMUNITY COLLEGE 
Pre-Teaching - Graduate Survey 



NAME 



' • ADDRESS 




2/ What college are you attending? . ' 

3. If employed: Is employment related to H.C.C. degree? 



Supervisor? " ■ . . 

4. If you have a major advisor or someone who assists you in 
planning your university program, what is his/her name? 



5. What was your G.P.A. at the ertd ^^f the last completed 
university semester? 

6. When do you expect to graduate from upiversitiy? T975 ( ) 
1976 ( ) after 1976 ( ) 

1. Did you attend H.C.C.: day ( ) evening ( ) weekend 
college ( ) 

8, Did your community college program prepare you to: 

To some 
Yes Extent Poorly No 



Yes ( ) No ( ) Where? 



a. ineet all the written com- ( ) 



( ) 



( ) 



( ) 



munlcations requirements 



at the university level? 



b. Interpret facts and. ( ) 

opinions objectively? 



( ) 



( ) 
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HILLSBOROUGH COMMUNITY COLLEGl 
Pre-Teaching - Graduate Survey Continued 



c. express yourself orally * ( ) ( ) 
both in class and to peer 

groups? I 

d. solve problems which require ( ) 
numerical interpretations? 



( ) ( ) 



e. evaluate data presented in ( 
graphical form? 

f. accept individuals who have ( 
been shaped by a variety 

of American cultures? 



identify the relationship {< 
between group culture and 
the development of your . 
individual personality? 



«5 



h. analyze current events and ( 
evaluate their effects on 
your personal welfare? 

i. solve problems using ( 
critical and logical 
thinking? 

J. evaluate the effective- • ( 
ness in style and form of 
the variety of art forms 
which surround you? 

k. evaluate the facts derived ( 
from scientific investigations 
and relate them to their 
implications on human welfare? 

1. identify specific historic ( 
actions -which help to shape 
the world today? 

m. recognize the forces which ( 
motivate you and influence 
your interpersonal relationships? 

' ■ 57 



( ) 
( ) 

i S 

( ) 

( ) 
( ) 
( ) 

( ) 

( ) 
( ) 



( ) 
( ) 
( ) 



( ) 



( ) 



( ) 
( ) 
( ) 



.( ) ( ) 



( ) 
( ) 
( ) 



( ) ( ) 




( ) ( ) 
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HILLSBOROUGH COMMUNITY COLLEGE 
Pre-Teaching - Graduate Survey Continued 

9. What course or courses did,you find most valuable? , 

• Why? ^ 

10. What course 6r courses would you recommend to a friend? 

. • Why? ■ 

11. - Which course should be omitted from a pre- teaching program?' 

12. WhaA would you substitute? .' . / 

HILLSBOROUGH COMMUNITY COLLEGE . 
Pre-Business Administration Graduate Survey 

HAME ^ [ ^_ ADDRESS 

' ' Z i p ^ ^ ' 

1. Are you attending college? Full-time ( ) Part-time,( ) 
No ( ) Major Area - 

2. What college are you attending? . 

3. If employed: IS employment related to H.C.C. degree? 
^ Yes ( ) No ( ) Where? Supervisor 

4. If you have a major advisor, what is his/her name? : 

5. What was your 6. P. A. at the end of the last completed 
university semester? - 

6. When do you expect to graduate from university? 1975 ( ) 
1976 ( ) aftef 1976 C ) 

7. Did you attend H«C.C.: day ( ) evening ( ) weekend college ( 

• ■ . I ' - 

5-8 • 
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HILLSBOROUGH COMMUNITY COLLEGE ^ 
Pre-Business Administration Graduate Survey Continued 

■\ ' " 

8. Did your Pre-Business Administrative program at H,C,C, prepare 
you to: 

. To some 
Yes ' extent Poorly No 

a. meet the writtefc com- ( )»• . ( ) ^ ( I (V 
munications requ\rements 
at the Ui^ersity level? 

b. accept individuals who ( ): ( ), ( ) ( ) 
have been shaped by a > 
variety of American 

cultures? ^ ' 

c. analyze current events ( ) ( ) t ) ( ) 
and evaluate their effects 
on your personal welfare? \ 

d. evaluate, facts derived ( ) ( ) ( ) ( ) 
from scientific investi- 
gations and relate them 
to their implications on 
human welfare. 

e. help to recognize the ( ) ( ) ( ) ( ) 
forces which motivate you 
and Influence your "inter- . 
personal relationships. 

f. evaluate company goals ( ) ( ) ( ) ( ) 
and display a management 
style in keeping with 
these goals. • 

g. apply statistics to ( ) ( ) ( ) ( ) 
basic business problems^ 

h. meet the mathematics ( ) ( ) ^ ( ) ( ) 
requirements of your 
UnlverfSity program. 
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HILLSBOROUGH COMMUNITY COLLEGE \ 
, Pre-Business Administration Graduate Survey Continued 



1 

1> discuss the use of a ( •) 
computer to solve business 
problems with computer 
programmers and other 
business students. 

J. evaluate the national ( ) 
economics in relation to 
businesses. 

to set up and Implement ( ) 
a accounting system for 
a small business. 

1.' calculate cost analysis i ) 
of products and services. . 

n. to determine pricing In ( ) 
relation to product :ahti . 
factor market$. - / 



( ) 



( ) ( ) 



( ) 
( ). 



• ( ) 

..•4 

9. What course or courses did you find most valuable? 

- ': -■. • " : - * t-. 

Why? 



( ) 
( ) 

( ) 



( ) 

( ) 

( y 

• r, 



it 



% ,) 



"7^ 



10. Which course or courses prcjsnde^ you Wvthh>the least antounr 
of useful informat^Qn?, /'^ % ' , ; ■ , •::^-<^ ' 

11. What type of course, KOuM you subst1tul6^^pr^e abpve? v^^v--^ V' 



12. Did you fl/id the leai^nlrtg- resources adequate a^t HiC.C. (tibraryi 
^ Learning,^ l/abdratory J T^iti^r^^ Yes'( ) No ^' ) ^ 

What chapges .^ifld ypu fecommendl ; v- ^ - . >' J ^ 
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, HILLSBOROUGH COMMUNITY COLLEGE \ 
. Pre-Police Science - Graduate Survey - 

' •> 

NAME ■ ADDRESS 



Are you attending college? Full-time ( ) Part-time^( ) 
No ( ) Major Area 

Miat College are you attending? ^ . . ' 

If employed: Is employment related to H.C.C. degree? Yes ( ) 
No ( ) Where?. ■ - ._ Supervisor 

If you have a major advisor or someone who is assisting you in 
planning your university program, what is his/her name? 



When do you expect to graduate from university? 1975 ( ) 
1976 ( ) after 1976 ( ) ^ 

Did you attend H.C.C: day ( ) evening ( ) weekend college ( 

Did your community college program prepare you to: 

- ' - To Some 

Yes Extent Poorly No 

a. meet all the written com- ( ) 
munications requirements at 
the university level? 

b. communicate effectively ( ) 
using the vocabulary and style 
necessary in police work and 
courses? 

c. Interpret facts and ( y 
opinions objectively? 

d. express yourself orally ( ) 
■ both in class and to peer 

groups? 

e. solve problems which re- ( ) 
quire numerical interpretations? 



( ) 



■( ) ( ) 



( ) 



.( ) ( ) 



. < 



( ) . ( ) 



( ) 



( ) 



( ) ( ) 



( ) 



( ) — ( ) 
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HILLSBOROUGH COMMUNITY COLLEGE ^ 
Pre-Police Science - Graduate Survey Continued 

f« evaluate date , presented ( > ( ) ( ) ( ) 

In graphical form? 

g. accept individuals who have ( ) ( ) .( ) ( ) 
' been shaped by a variety of 

American cultures and relate 
your knowledge to police 
work? 

h. identify the relationship ( ) ( ) ( ) ( ) 
between group culture and 

the development of your in- 
dividual personality? 

i . analyze current events and ( ) " ( ) ( ) ( ) 
evaluate their effects on ' 

police work? 

utilize your knowledge of ( ) ( ) ( ) ( ) 

criminal justice agencies 
and the court system to 

solve problems in police / 
work? 

k. apply the scientific method ( ) ( ) ( ) / ( ) ^ 

in explaining or collecting 
the facts necessary in a 
police investigation? 

1. explain the^overall opera- ( ) ( ) ( ) ( ) 

ti on of law enforcement agencies 
as they relate to U.S. Supreme 
Court decisions? 

m. explain the management and ( ) ( ) ( } ( ) 

operational functions, role ^ 
and facilities of a police • ^ 
department? 

n, describe the capabilities ( ) ( ) ( ) ( ) 

and services that can be pro- 
vided by a police laboratory? 

0, describe enforcemefnt and ( ) ( ) ( ) _ C ) 

education required^in traffic 
enforcement? ^2 
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HILLSBOROUGH COMMUNITY COLLEGE ^ 
Pre-Pol ice Science - Graduate Survey Continued 

. . 

•> • ■ - - •• 

p. recognize the forces which j( ^ • ( ) ( ) ( ) . 

. motivate you and influence ' U 
your interpersonal relationships? 

9. What course or courses did you find most valuable? . 
Why? - • > .. , ' 

10. What course or courses would you recommend to a friend? 
- ' ■' ■ Why? . 

11. 'Which course shoulid be omitted il*om a pre- teaching program? 

' /"^ ' "~ ' ~~ " 

12. What would you substitute? '__ 

These questionnaires, after acceptance, were reproduced and 
disbributed to the program managers for pre- testing with 30 
students who were presently enrolled in the second year of 
their programs. Upon completing the questionnaires, a discussion 
was held with these students regarding interpretation of the 
questions and the vocabulary used on the questionnaires. No 
problems were identified regarding the questionnaires. The 
questionnaires were then mailed to the graduates in each program. 

In reviewing the questionnaires together with the data received- 
from the randomly selected graduates, the program managers In Pre- \ 
teaching on two campuses recomniended that In future years 
be rank ordered. They further suggested that the criterion-referenced 

63ii 
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questions be placed In the same order as the goals. ^ Six faculty 
members and two program managers suggested that questions regarding 
counseling and library and learning laboratory facilities be added 
to the questionnaire. These two suggestions have been Incorporated 
into the 1975-76 questionnaires- 

Another suggestion, tjiat the questionnaires be modified » was 
made' by a school psychometrlst on reviewing the results. This 
suggestion was to Identify each section of the. questionnaire; 
descriptive data, criteria-referenced questions and open-ended 
questions. In sonjg. malnner. The method adopted was to use dlf- 
ferent stylps of typing. The psychometrlst also recommended that 
yellow or pink papers be used In order to Increase returns. (Appendi 
D) o ^ ' 

University Questionnaire . The Dlrectbr of Follow-up developed 
a draft questlbnnalV^e for each program to be sent to the University 
Instructors of the graduates from that program. These draft 
questionnaires! were forwarded to the program managers and faculty 
members In each program. These questionnaires were also used In the 
discussions with University personnel. 

An appointment was made by the Director of Follow-up with the 
Dean and/or Department Chairman ^of each ^^rogram at the- University 
of South Florida. InXthe College of Education, the meetings were 
held Individually with the Dean of the College of Education and 
the two department chairmen. At this time, the system, the state 
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requirements and the questionnaires were discussed. \ The Dean 
and Department Chairmen agreed to assist In the project and to 
encourage their instructors to parti ci pa j;e>^ 

\ In the Business Administration Department, the Dean scheduled 
a meeting with all the Department Chairmen and the Director of 
Follow-up. At this meeting, the systeni, state requirements and^ 
the questionnaire were discussed • The University personnel sug- 
gested that a "n6t applicable" column be added to all criteria- 
referenced questions prior to use. All tfte department chairmen 
agreed to assist In this project. 

The Department Chairman of the Criminal Justice department 
called a faculty meeting at which the system, state requirements, 
and tWe questionnaire were explained. The members of this depart- 
ment agreed to assist in this project. 

As a result of these meetings, it was suggested by the University 
Instructors that a "not applicable column" be added to all question- 
naires. This recommendation was adopted in the final questionnaire, 
shewn In the following: 

Follow-up Survey \.. " 

Hillsborough- Community College ^ 
Pre-Jeaching Graduates Attending University 

Graduate * Address 

Major Advisor or Professor 

Subject 
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Follow-up Survey ^ 
Hillsborough Community College 
Pre-Teaching Graduates Attending University Continued 

The H.C.C. graduate named above has identified you as their 
major advisor or a professor. Would you complete this form 
regarding the graduate as completely as possible. 

*l. Do you find the Hillsborough Community College 
graduate named above prepared to: ^ 

To Some 



a. meet the writtetl-! 
communications 
requirements at the 
university level? 

b. interpret facts 



Yes 
C ) 

( ) 



and opinions objectively? 

c. express himself/ ( ) 
herself orally in class 
and conferences? 

d; solve problems which ( ) 
require numerical 
interpretations? 

e. evaluate- data pre- ( ) 
sented in graphical form? 

f. accept individuals'^ ( ) 
who have been shaped 

by a variety of American 
• cultures? 

f ^. • ' 

g. Identify the relation-( ) 
ship between group culture 
and the development of • 
Individual personality? 

b. analyze current ( ) 
events and, evaluate 
the effects on personal 
welfare? 



Extent 
( ) 



( 
C 

( ) 

( ) 



Poorly 
.( ) 



( ) 

( ) 

( ) 

( )^ 

( ) 

( ) 

( ) 



No 

( ), 

( ) ( 

( ) ( 

( ) ( 

( ) ( 

( ) ( 

( ) ( 

( ) ( 



m 
( ) 
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Follow-up Survey 
Hlllsboroujgh Community College 
Pre-Teaching Graduates Attending University Continued 

i. use critical and ( ) ( ) 
logltal thinking In 
solving problems? , 



Do you feel the graduate was prepared to 
undertake the academic requirements of 
university? 

Comments: " ■ • . . 



Do you feel the graduate understood the job ( ) ' ( ) 
opportunities and demands of the program 
for which they were training? 

Comments: . - 



( ) 



,( ) ( ) 



Yes 

TT 



No 



Do you feel the graduate was prepared to . ( ) I ( ) 

evaluate and. use the support resources of 0 . 

the University? 

Comments: - • ' > 

^ ■ : — — — ' — — - 

Oij the basis of your tnowledge of Community ( ) ( ) 
College graduates* would you recommend other 
students receive their first two years of 
education at a Community College? 
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HILLSBOROUGH COMMUNITY' COLLEGE ,: ^ ' 
. - ' .. Pre-Biisiness Administration ' ^ 

■■ ' ' . University Survey : ^ 

INSTRUCTOR/ ADVISOR ■ ' " ' 

ADDRESS ' • ■ ■ DEPARTMENT ; 

' ' ■ - ' . - ■ -■ r. , ■ '\ 

GRADUATE ■ '■ • ■ . 

^"^^ ■ - ; V, 

1. For what course or courses did-yoii have thts Community College 
•graduate as a studertt? • 

' . None ( y 

2. Do you find the Hillsborough Community College graduate 
named above prepared to": , ^ ; • vcit 

' Yes Extent; • . Poorly ' No 

a. meiet the written ( ) . ( ) ( ) ( X ( ) 
communications require- 
ments at the university, 
level . . , , . 

b. recognize the ( ) ( ) ( ) ( ) ( ) 
forces which motivate 

him/her to improve 
Interpersonal relation- 
ships. 

c. prepared t6 evaluate ( ) ( ) ( ) ( ) ( ) 
management styles if 

given cbmpany goals. 

d. apply statistics ( ) . ( ) ( ) ( ) ( ) 
to basic business problems. ^ _ 

e. ^et the mathema- (• ) ( ) ( ) ( ) ( ) 
^Ics requirements of • • \ 

your university program. ^ . 

f. discuss the use of ( ) ( ) ( ) ( ) ( ) 
a computer to solve 

business problems with 
computer programmers. 



c ■ ■ . 

evaluate the ( ) 

national economics 
In relation to 
business. . 

h.» display know- ' ( ) 
ledge of accounting 
systems adequate for 
a pmall busine^. 

1. analyze cost of ( ) 
products and segrvices. 

describe pricing ( ^ 
techniques in relation. 
t?to product/^nd factor 
markets. 



HILLSBOROUGH COMMUNITY COLLEGE 
Pre-BusTness . Administration 
University Survey Continued 



( ) 



( ) 



( ) 



( ) 

( ) 

( ) 
( ) 



( ) ( ) 



( ) t ) 



( ) 
( ) 



( ) 
( ) 



Do you feel the graduate was prepared to undertake the acadair.ic 
requirements of the university? 



Yes ( ) 
Comments : 



No ( ) 



Do you feel the graduate was prepared to evaluate aqd use th; 
support resources of the university? 



Yes ( ) No ( ) ^ 
Comments: . 



In which academic area did you feel the graduate was most 
prepared? • " " 
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HILLSBOROUGH COMMUNITY COLLEGE \ ^ 
Pre-Bu^^ ness. Admin is t^^^ 
University Siirvey Continued 

. ; * 

6. In wh1<:h academic area did you feel the graduate >(as least 
prepared? r 



7. On the basis of your knowledge of Community College gradyatis,*; 
would you recommend other students receive thejr education i 
•at a Community College? ' 

%s \ ) No ) . • \ ' ^ ^\ I 

Comments: - . I 



HILLSBOROUGH COMMUNITY COLLEGE 
Pre-Police Science 
University Survey 



INSTRUCTOR/ADVISOR ' '. DEPARTMENT 

ADDRESS ' 

GRADUATE 



1. For what course or courses did you have the Community College 
graduate as a student? 



None ( ) 



2. Do you find the Hillsborough Community College graduate named 
above prepared to: 

To 

Yes ExtaMf Poorly No N'A 




a. meet all the written ( ) ( ) ( ) ( ) ( ) 

communications require- 
ments at the University ^ 
level? 
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HILLSBOROUGH COMMUNITY COLLEGE \ 

— Pi)e-f>ot1ce-ScterTce — ' " 

, - University Survey Continued 

b. interpret facts ( ) ( ) ( ) ( ) ( ) 
i and opinions objectively? 

c. express themselves ( ) ( ) ( ) ( ) ( ) 
oraTly both in class 

and io peer groups? ; 

•d. solve problems ( ) ( ) ( ) ( ) ( ) 

which require numerical 
Interpretations? 

e. evaluate data pre- f ) ( ) ( ) ( ) { ) 
sented In graphical 

form? 

f. accept Individuals ( ) ( ) ( ) ( ) I ) 
who have been shaped 

by a variety of 
Amerlcaa cultures. 

g. utilize their know-( ) ( ) ( ) ( ) ( ) 
ledge of criminal 

justice agencies and 
the court systlem to 
solve problems. 



h. explain the over- ( ) / ( ) ( ) ( ) ( ) 

all bperation of law 
enforcement agencies 
as they relate to U.S. 
Supreme Court decisions? 

explain the manage- ( ) ( ) ( ) ( ) ( ) 

went 'and operational functions, 
V role and fac11iti« of a 
police department? 

Do: you feel the graduate was prepared to undertake the academic 
reijuirements pf the. university/ 

Yes ( ) rto( ) 

CiDmments: X— 
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Component Three;. Conectinq of Data 

^ .Hfllsborough Community College Graduates , The first mailing 
of 30 questionnaires to the graduates from each program was done 
in Novemhe)* 1974, immediately before the Thanksgivihg vacation, 
the mailing included a personalized letter, self-addressed, stamped, 
return-addressed envelope and the questtcfnnaire, 

Jwo weeks after the, first mailing, those graduates who had not 
returned their questionnaire were telephoned. Although the method 
of telephoning increased returns, after three attempts many students 
could not be reached and in some cases where the family could be 
reached, they could not speak English. Because of the cost and time 
Involved, this method of contacting graduates will not be continued. 

The second mailing was done In the middle of December and a 
third mailing was done the day before Christmas vacation. These 
methods of contacting graduates produced the following returns: 

/ 

TABLE 4 

Graduates Rate of Response to Questionnaire 

1st 2nd .3rd Cumulative 

Mailing Telephone Mailing Mailing Percent 

Pre-Teaching 14 4 3 2 77 

Pre-Business 

Administration 11 3 . 7 4 83 

Pre-Police 

Science 11 2 6 1 70 
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The overall returns of 74. represents 75 percent. \ A 75 per^ 
cent return Is an acceptable rate of return for a mall question- 
naire (Wallace, 1974). ^ 

Of these, 70- percent were attending tfniversity of South 
Florida. Therefore, this was the only four-year college or 
fi^'llpiverslty Included in the system. 

Percent of 
Respondents 
Total Attending Attencling 
* . Response University University 

Pre-Teaching 77 16 66 

Pre^-Business Administration 83 - 14 58 

Pre-Police Science ^70 13 59 

ATI of the graduates who returned the questionnaire answered 
the entire questionnaire. Seventy graduates (or 99 percent of 
those answering), offered comments to the questions, and 32 graduate, 
(or 45 percent) offered additional cormen 
from which they received thefr Associate in Arts degrees. 

The mean of all criteria-referenced questions Was established, 
using a four-point scale. This scale used "yes" as four points 
and "no" as one. These means were then graphed, using all graduate 
responses for each\program. (Figures 2, 3, 4) 

In describing the graduates who did not return the question- 
naire in relation to those who did respond, the characteristics 
of age, grac|e point average and credits earned at Hillsborough 
Community College were examined, as shown in Figure 1. 
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Average Characteristics of llespojidents!V^ Non/res|^jSnts>:^ 



Pre-Teaching 
respondents - 23 
non-respondents - 7 

Pre-Business Administration 
respondents - 26 
non-respondents - 4 

Pre-PoHce Science 
respondents - 22 
non-respondents - 8 

*NR.= Non Respondents 



25 
26 
21 



rvi-:i^uV*':^^ ^; ^•arjied'^ 
-A ge . ^ Average ^ H>C,C> 
NR* R m ^ NR. 




2a 2,95 2.5 ^ 55.9 
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27 3.05 2.7 55.6 65 



29 3.16 3.0 5 51.7 
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Examination of the^ tables indicated that the non-respondents 
were older, had a somewhat lower grade point average, and had 
accumulated more credits before receiving a degree. No conclusions 
can be drawn from these results because the sample of non-respondent 
was very small . * 

University of South Florida Instructors . Using the University 
of South Florida locater for Winter Term 1974, 54 instructors who 
were teaching^Hillsborough Community College graduates were 
Identified. The numbers In each program were: 

N 



Pre-Teaching 

Pre-Business Administration 
Pre-Police Science 



29 
15 
10 
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' — The questionnaire^ wer.|^il(^ 

sixth week of an eleven-week term. The mailing included a lett^^ 
explaining the project, a self -addressed, stamped envelope and 
the questionnaire. On receipt of the questionnaire^ and letter, 
three instructors telephoned the Director of Follow-up for further 
Instructions. Also, two Instructors wrote the Director of Follow- 
up for further clarification of the project. All of these in- 
quiries were answered, and led ^to a revision of. the letter of 
explanation (Appendix E). , • 

The second mailing was done in the first week of the Spring 
term. Fdr the purpose of the second mailing, the revised letter 
was used. This letter contains more detailed information regarding 
each student. 

The third mailing to the University Instructors was done two 
weeks later. The response to these mailings were: 

TABLES ' 

University Instructors 
Response to Mail Questionnaires 



^ 1st 2nd 3rd . 

' Mailing ' Mailing Mailing F^rtent^ 

Pre-Teaching 17 3 3 79 

Pre-Business 

Administration 7 4 3 93 

Pre-Police Science 10 0 0 100 



EKLC 



.Three University instructors, representing 15 percent, respond 



ing to these mailings indicatirig that the students never attended 

• ■ • . ■ ■ / 1 

the courses in which they had been registered. 

•The total returns of 47 of the 54 university instructors 

questioned represents an 80 percent return. Of those who res- 

jporided, 40 which represents 74 percent, were able to answer the 

questionnaire. ^ 

These results represent adequate returns fprthis type of 

.quetstionnaire. They also indicate that this system isv^,^^^ 

•Ijp X)btaining evaluation information regarding perfo^iiiance'^of 

^r^duates in transfer institutions, anjJ provides the necessary 

^saita for program evaluation. 

fiMnponent' Four; / Analysis of ETata 

i ^llsborough Cotrmunity College Graduates . The criterion 

referenced data from the graduates who responded in each pro- 

areim was graphed. These graphs are as shown on Figure 2, 3, 4. 

FIGURE 2 

|1^an Responses of Pre-Teaching Graduates to 
Criterion Referenced Questions 



l^) pieet all the written 
Communications re- 
quirements at the 
university level? 

{b) interpret facts and 
" ' ppinibns'objectively? 



1 
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1 




1 


1 


1 




1 


1 


1 




1 


1 


1 




1 


1 


1 
1 




1 

1 


1 
• 


1 





76 



FIGURE 2 



HMrilTespdnse^^^^ 

Criterion Referenced Questions Continued 

1 2 3 



(c) express yourself 
orally both in class 
and to peer groups? 



fl||problems which 
luTre numerical 



(d) sol 
req 

Interpretations? 



(e) evaluate data pre- 
sented in graphical 
form? 

(f) accept Individuals 
^ who have been 

< shaped by a 
variety of 
Ttaierican cultures? 

(g) identify the 
relationship 
between group 
culture and the 
developnent of 

* your individual 
personality? 

(h) analyze current 
events and evaluate 
their effects on your 
personal welfare? 

(i) solve problems using 
critical and logical 
thinking. 



(j) evaluate the effective- 
ness in style and form of 
^the variety of art forms ^ 
which surround you? ^ 
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FIGURE 2 



Mean Responses of Pre-Teaching Graduati^. to 
Criterion Referenced Questions Gontiffed 



(k) evaluate the facfs de- 
rived from scientific 
investigation? and. 
relate them to their 
.implications on human 
•welfare? 



(1) identify specific 
historic actions , 

/i/hich help to shape 
the worW* today? 



(m) recognize the focces 



)Ece 

which motivate yd|| and 
influence your inter- 
personial relationships? 



j 


1 

i 
} 


2 

j 

i 


3 
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FIGURE 3 V 

Mean Responses of Pre-Business 
Administration Graduates to Criterion 
Referenced Questions 

. • 1 2 3 4 

(a) meet the written I ! t 
communications re- | { ! i 
quirements at the ^ } J - ' ! I 
University leveK imhhi^^^mmmmhmi^ 

(b) accept ir«|ividuals ! I ! I 
who have oeen |^ } | 
shaped by a variety J } } j 
of American cultures. ^^^^^m^^mw^^M^mum^ 

(c) analyze current ' \ \ ' \ I 
events. and evaluate •! " I I I 
their effects on your .j { | 1 
personal welfare. ! !^_ | 



7.8 
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FIGURE 3 

Mean Responses of Pre-Bus.iness , 
Administration GradiJates to Criterion 
Referenced Questions Continued 



(d) evaluate facts derived 
from scientific investi- 
gations and relate, them 
to. their implications 

on human welfare. 

(e) help to recognize the 
forces which motivate you 
and influence your inter- 
personal relationships. 

(f) evaluate company goals 
and display a manage- 

^ ment style in keeping 
with these goals. 

(g) apply statisticis to 
basic business problems. 

(h) meet the mathematics 
requirements of your 
University program. 

(i) discuss the use of a 
computer to solve 
business problems with 
computer programmers\and 
other business students.. 

(j) evaluate the national 
economics in relation 
to businesses. 

(k) to set up and implement 
an accounting system 
for a small busiaess. 



1 



79 
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FICyRE 3 

Mean Responses of Pre-Business 
Administration Graduaetes to Criterion 
.Referenced Questions Continued 



py calculate cost analysis 
of products and services, 

(m) to. determine pricing ^in 
relation to product and 
factor markets. 




FIGURE 4 



Mean Responses of Pre-Police 
'Science Graduates to Criterion. 
• Referenced Questions 



1 



(a) meet all the written 
communications require- 
ments at the university 

level? 

« 

(b) . communicate effectively 

using the vocabuTary 
and style necessary in 
police work and courses? 

(c) interpret, facts ;and . ^. 
opinions objectively? 

(d) express yourself orally 
both in class and to peer 
groups? 

(e) solve problems which 
require numerical 
interpretations? 

(f) evaluate data pre- 
sented in graphical 
form? 
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FIGURE 4 



Mean Responses pf Pre-PoTice 
Science Graduates Criterion 
Referenced Questions Continued 

• 1 2 



(g) accept individuals whb 
have been shaped by a 
variety of American 
cultures and relate your 
knowledge ^ police work? 

(h) ^ identify the relations 

between group culture 
* the development of your : 
individual personality? 

(i) analyze"^ current events 
and evaluate their effects 
on police work? 

(j)- utilize your know^ledge 
of criminal jUstfce 
agencies and the court 
system to solve problems 
In police work? 

(k) apply Jhe scientific' 
methodtin explaining 
or collecting the facts 
necessary in a police 
. Investigation? 

(1) explain the overall 
operation of law 
enforcement agencies 
as they relate to U.S. 
Supreme Court decisions? 

(m) explain the management 

and operational functions, 
role and facilities of 
a police department? 

(n) describe the capabiltties 
and services that can be 
provided by a police 
laboratory? 
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FIGURE 4 



(b) describe enforcement 
and education required 
. In traffic enforcement? 

(p) recognize the forces 
.which motivate you and 
Influence your Inter- 
personal relationships? ;^ 



Mean Responses of Pre-PoJIce 
Science Graduatef^ to Criterion 
Referenced Questions Continued 

1 2 
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The descriptive data and comments were condensed and became part 

I he package forwarded to the prDgram managers and faculty members 
0 were part af the system. They were asked to comment on this 
Information wIthlVi two weeks. 

The number of Hillsborough Community Qollege faculty Including 
program managers who were Involved in the system at the time were: 




Pre-Teaching 

Pre-Buslness Administration 
Pre-Pollce Science 



N 
11 

9 

5 



Hillsborough Conmunlty College program managers and faculty 
J5ejnbexs_wexe_a^^^^ ^gaLs and^ questionnaires and 

asked toyr^view the package for any recommended changes. 

When the ^information was not returned within two weeks, the 
Director of Follow-up telephone those faculty members not respond- 
ing. For eight Individuals; a third telephone call was necessary. 



\ ' ; TABLE 6 

Hillsborough. Community College 
Faculty Members and Program Managers , ; . 

ResMse to Evaluation Requests 

1st • 2nd 

- 1st Telephone' Telephone - 

• ' Request Request Request , Percent 



Pre-Teaching 



1 100 



Pre-Busi^iess V ' - 88 , 

Administration. [ 3 . , . ; ,v . 

P«»B-Pol.ice , ., , ■ ' / '3 #v 1. 100 

Science • ^0 . ' ^.i- 

' Ten of the faculty members Who responded recommended that - ^ 
addi tional f acul ty members • names le added to= the system. 
^ .\ 0f the individuals who reviewed, the data. 19 recornmended , 
^curriculum changes, ten suggested :*e.v1s ions to the questionnaire, 
and. five s^uggested revisions of the goal statements. 

..n.»pr.uv Instructors . The university instructors who re^^ 
turned the questionnaires *in each program were: 

23 79 
Pre-Teaching ^ - " * / 

Pi*£-Business Administration If 
Pre-Pol ice Science ""O 

• 'V The criteria-referenced. questions' were analyzedl including 
the ''not applicable" responses, and the results were placed on ^ 
a bar graph. v ^ 
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J^tGURE 5 



Mean Resp6nsj?s of ^(Jniversity ^ . ^ . 
Instructors to tKe^^ri terion-Referehced 
Questions on the Pre-Teaching Questionnaire 



' (a) meet the written com- 
munications required 
ments at the*universi>t 
level? *1T% 

(b) interpret facts and 
op^n^ons objectively? 

(c) express himself /her self 
orany? 

(d) solve problems whic 
require^umerical 
inter pretiat ions? *50% 

(e) fevaluate dfte pre-^ 
^ sented in graphical ; 

form? 



(f) accept individuals 
V who have been shaped | 

; . by a varietyv.of ' ■ 
?' American culfur^? *27% 

^ ■•■ - 

(g) identify the fftla^tidn- 
'r shio between grt^p ; . 

culHire and the 
development *of .indi- ' 
vidual personality? 

(h) analyze ^curreot events* 
and 'evaluate the effects 
>Dn personal, welfare? 

(i) use critical and logical 
, thinking in solving 

problems? , , 
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FIGURE 6 



X 



On 



Mean Response of University Instri/fctors 
to the Criterion-Referenced Questions 
the Pre-Business Administration Questionnaire 



(a) meet the written com- 
munications riequire- 
ments at the university 
level? 22%* 

(b) recognize the forces 
which motivate 
him/her to improve 
interpersonal relation- 
ships?. 55%* 

(c) prepared to evaluate 
management styles if 
given company goals? 
4«* - . 

(d) apply statistics to 
basic business 
problems? 66%* * 

i) meet the mathematics 
requirements of your . 
university program? 
' 66%* 

(f) discuss the use of ^ 
a computer to solve 
business problems ^ 
with computer 
programmers? 88%* 

(g) evaluate the national 
economics in relation 
to businesses? 88%* 



1 









— f 


r 


1 V 


i 








1 




j 

- 1 


1 


! 


1 






1 


^ 1 


^ 1 




1 " 

.!.■'>■ 






A 1 


1 
1 
1 
1 




1 




1 


1 



74 



FIGURE 6 



lleari Response of University Instructor^ - 
to .the Criterion- Referenced Questions 
On the Pre-Business Administration Questionnaire 

Wrttinued 



(h) display knowledge of 
Accounting systems ' 
adequate for a small 
jsiness? 55%* 



(1) anajtjfze cost of . 
products and 
services? 77%* 

(j) ^describing pricing 
techniques in 
relation to products 
and factor markets? 
88%* 

^Not Applicable 



1 . 2 ^ , * 



1 



FIGURE > 



.^Mean Responses of University ^ 
Instructors to. the Criterion-Referenced 
Questions on the Pre-Police Science Questionnaire 



(a) meet all the written 
communications require- 
ments at the university^;*^ 
level? *10% 



(b) iht#pret facts and,i. 
dpi liions objectively? 

(c) expressHhejp^l ves 
orally boti^in class 
and to peer groups? *10% 



1 
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FIGURE 7 



Mean Responses of Univ^iplyV 
Instructors to the Criterion-Referenced 
Questions on the Pre-Police Science -Questionnaire 
^ - Continued ' v 

1 2 .^3 



(d) solye problems which' 
^rec^juire numerical 

Interpretations? *90% 

(e) evaluate data presented 
, in graphical form? 

1^) acci^pt individuals who 
'hirt^^been^ shaped by a 
A^##6ty^ 

ize/thei^:^^now-. <: - 

yce^.ehcie ^hd ^ 
^^' IS^ystem to 

' ' '' 




IF 

''■ A final reportSMBp^pWea Tor each pro^ 




>d f or each progn ^ 
.reports were subm^'l^iaMBall program managers and faculty members for 
correction%and iJHMftatiop. These reports were accepted as written 
andvwere then introduced into formal decision-making process. 

Component Five: Introducing Datet into the Decision-Making Process 

The final reports were forwarded to the campus directors, 
directors of instruction, and collegium directors. Also, these 
^reports were sent to counselors, librarians, graduates, instructors 
at the University of Soutli Floricja who participated, as well as 
department chairmen and deans at the University of South Florida. 
Tha coordinator for community colleges at the University South 
Florida also was sent a copy of the final rep^^ts. 

Responses were received from the campus director at Dale Mabry, 
the directors of ins^truq^on at DaVe Mabry and Ybor City, and .the 
coordinator for comiiiunity colleges at the University of South Florida 
(Appendix 6). 

% . Of the individuals who reviewed the data, 19 recommended 

cufjjriculum changes, ten suggested revisionsB^to' the questionnaire, ^ 
and five suggested revisions of the goal statements. ^\ 

These repj^ts^ is well as^a review of the ^system, were^rei 
sented by the Director of Follov^iip to tttl Isbo rough ConinSl|lj!y\Co liege 
decision-making corranit^ees. The Academic Affairs Couricil , Planned 
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Program Budgeting System/Management Information Systems Conmittee 
and the Committee for Articulation committee between Hillsborough" 
Community College, Hillsborough County Board^bf Public Instruction 
and tie University of South Florida^ also the Hillsborough Community 
College President's Counctl, and the Hillsborough Community College 
District Board 'of ^ustees. The reports were well received by each'" 
coimiittee and the members took an active part in asking questions. 

The Acad em ic^Af fairs Council recommended that the Director of 
Follow-up be made a research member of this committee. Furthermore, 
they moved that the agendas and minutes of all meetings be sent to 
the Director of Follow-up. , - 

The P.P.B.S./M.I.S. Committee requested clarification f|pm 
the President •§ Counct]|j8|; to who would be responsible for 
Implementing sug^stionsT and stuggested the P.P.B.S./M./I .S. Coimittee 

be responsible for monit^^ngi^^lb^l^ 

. The President's Cot»^i^jil^3feVed ^e- reports and further re- ^ 




quested .that the ^lred^^^fl^jj0-^ ^" interim report 

|hj8^hs -regarding the progress tna^^ to • implement recom- 

^^eS'ifcuVefetiVn C received the report w*ith interest 

and requested to be kept informed. The Hillsborough Community 
College District Board of Trustees made no comment on the report. 

- mt-f ^ ■ • 
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Utilization of the five components for devetopirig a graduate 
follow-up system for decision-making regarding programs and/or 
curriculum was^uccessful ^ Each component provided the necessary 
/participation' by facultjjlhiembers to implement change and decision- 
making by those members of the professional staff closest ±o the 
. (ft.. . 

students. ' . ' ' 



s 



CHAPTER V .. ^ 

1. 

Discussion and (conclusions 

The System . 

this chapter presents a framework for use by community ^• 

colleges developing graduate foil ow-up'^S^^ for specific 

. .. ' * 

associate in arts programs. The Hillsboroug)i system describes 
the methods by which a conmunity college can identify, in per- 
formance or competeB^ij|^^ desired outcomes of each 
program and measure graduates' achievement of these outcojnes. # 
It is basic to the development of this system' that mutual 

'und#sfanding and willingness to participate by individuals at 
all levels of the community college and four-year institutions 
Involved be undertaken. -Therefoce, the philosophy of the community * 
college and four-year coll^g|S and universities regarding curriculun 

.Improvement and evaluation must be understood. The adminis^ative'* 
structure of the community college and four-year colleges an4 < 
universities that are a part of the system mus£ be examined and 
considered. Approval to implement the 'System and staternents of 

^^'sulpport from the necessary members of the community college 
administrative stafl" must be received. Further, it is important 
that the necessary financial commitment to this project be achieved 

^before any work is begun. V, 
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It is of equal Jiiiilil'tance that faculty, who are directly 
responsible for impfefnentation of curriculum designed to achieve 
the program goals, support the research, understand the project. 



and express willingness to assist iit development, implementation 
and evaluatio|j*f the project. Faculty must be encouraged to make 
recommendations for changes in program goals and curriculum that 
are identified as a result of this Voject. Everett (1969)states 

' . ^ "... 

that faculty Involvement i§ an Important aspect. In the development 
of any system designed to evaluate curriculum. This faculty involvg 
ment creates an atmosphere of gr*eater acceptance and more^Plctlve^ 
change. % ^ , 

' Finally, a D.irectlr of Follow-up for the entire systepi must be 
named and provided with suffilcient support and administrative 
flexibility to work effectively with all components of the 
system. Everett (1969) states that there are strong feelings 
among faculty and administration that there should be centralifed 
responslbllty for follow-up studies as part of institutional re- 
search. K ' V 

Having |ich|eved support and understanding with all these 
individuals, a pilot pro^^dt U ready to be established. The 
pilot project should involve no more program^hat the Director of 
Follow-up is able to handle, but must contain enough programs to 
provide for valid evaluation oV the system. It is Suggested tMt 



thr6e to five transfer\)rograms 'be used in ifie pilot pioject- 

Another consideration before the pilot project is begun is 
the development of the sequence of events considering the institution 
yearly calendar of the four-year institutions and community college, 

^Component One: Developing Program Goals 

' An institutional definition of program must be established by 
the community college beginning this project. This can be done by 
examining the community college catalog and identifying the pro- 
fessional options provided by the institution. However, in some 
rCAtal'ogs these are riot well defined. 

A^faciilty member who is responsible for development of the 
major core" curriculum . in these professional cours^ should be named 
program manager by the administration. Tp;;;,6eg,in the pilot projects, 
program managers should be named in the spring of the preceding 
year. (Appendix H) 

. Some characteristics of th^ individual faculty member should : 
be considere|(i when the, administration is naming program managers. 
■T|feise*sjxouid\includ ability to communicate effectively: with other 
faculty members willingness to accept the^position, experience In trie 
curriculum aiSea for which they are developing 90^> nigh%^^- ^ ^^'"^^ 
credibility with faculty members .regarding their interest in) ^ 
students arid' curriculum development, ability to conduct the^elves , 



in a: non- Intimidating vHy with other faculty members. There 
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should be some type of compensation for this lyacfement responsibility. 

The Director of Follow-up should conduct informal meetings / 
in the spring with each program manager to explain the system. | 
As a result of these meetings i each pro^rani loapaget*;^ 
to twelve goals for his program stili|lifeperfoh»a 



based language. Also, the Director of Follow-up should use these 
■ meetings to identify program manag^r^who indicate an intere14r* ^ 
in becoming Vpa.rt of the pilot project. Those. interested program 
managers should provide, the Director of Follow-up with a list of 
faculty who would be willing to act as resource people for. their 
program.^ These faculty members should be included in the develop- 
ment of the project at each step. 

In identifying, pilot programs some criteria td consider are: 
- sufficient number of graduates to provide an adequate population 
^^^Sv* the pi tot project and for continuing evaluation, a diverse core 
curriculum, and a pKogram manager willing to participate. When - 
the pilot programs are identified the program goals should be, ' 
reviewed by the Director tjglpljtfe t^e^-^^^ are stated in 
/ performance or competency-bl^^Tanguage and , agree with the 



institutional goals. They shoyld then. be returned to tlie proigram 
manaigers. to be rank ordered. These rank-ordered goals provide ' - 
the basis for the DirectoVof Follow-up sto develop thel questionnaire; 
At no time in^the devel.fiq^ment of the program goals should the 



Director evaTuate me Content of the§e goal s . The rel evancy and 

O .• - • ., Q ' "...4 ■ . 
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validity of the goals are evaluated by the self-correcting mechanism 
of the system, • : 

component Two; Development of the Instruments 

The design of the instruments should be developed by the Director 
of Follovit-up using the assistance of a psychomet«ist, AH quest4on- 
' naires; shq|(pa be short requiring a maximum of fifteen minulfes to 
..complete. 4 ' / \ - ^ ^ 

The graduate questionna(fres. should include descriptive informa- 

' ■ ' .. . ' > 

tion> enter ion- referenced questions, and opeji-ended ^juestions! 

Each section should .be distinguished in some manner.; This can be 

done by changing type, spacing or margins. The criterion-referenced 

questions should cover all the performance based statements re- 

garding the program as identified by the program manager and aUo 

provide for the evaluation of supgior-t services, such as: library, 

learning laboratory, student govdrfjijeoV counseling, financial aid, 

arid placement. i-. ^ 

The open-ended questions should allow for specific suggestions 
regarding curriculum additions or deletions, and descriptions of 
any transfer problems they' nivfe encountered. , The open-ended 
questions should also allow for perceptions yr«l^ the specific 

strengths' aVd%eaknesses of the program."^ " 

All graduate questionnaires, in order to comply with/the Buckley 

r/^n.dij»erit^>inust contain a question which allows th§ Direttor of 

&y?T^''^--r,::;r ■ , ■ - » ' " \ ■ 

bbtaijfi infromatioh from the four^^y^r colleges and 
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universities. The Buckley ' Amendment if. public law 93-980, "The 
Faculty Educational Ri'ghts aj^lr^acy^^^^ 1974", and prohibits 

the release of information regairdiipg*^ students' educational progress 
to anyone other than those 'individuals .designated by the students^ 
The easiest way to comply with this act^ which went into effect in 
January 1975, is to have the graduate agree' to the release of in- ; . 
formation. ' • >: 

Instructors' Questionnaire : The i nstruCt( M| ^ M b^jUo , 
should contain similar cri terionrreferenced S^'^HHr ^^^^^ 
order as the graduates questionnaire to a1 Ww^^pJ^ 
of the results, and open-ended questions. reg^rd||tt specific cur- 
riculum problems* The questionnair'C for t^p|ftf£fuctoirs at the 
four-year colleges^ and uni vers i^ties should*^"be prepared prior to 
the meeting with these individuals. ^ , 

At the time of the first formal or informal meeting with 
university personnel, the Director of Follow-up should explain the • 
process structure, and expected resul ts of the project, as well ,as ' 
the use of the results by the community college and their part 
in the system. The instructors at the four-year colleges ajid 
universities shoyld be encouraged to offer suggestions orYe- 
commendations for revision to thV system* or ins; truments. These 
suggestions should be incorporated whenever possible. 
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•■ ,;,„s of each ,„,st1o»naire-a.e developed, they should 
.e „,del. d.tH.ted to .0.*; .e™.e. pro.e. ™ana,e.s o. , 
•.^,e.t1ons and revisions: «^en consensus has .een reached. 
C lates- .es.onna.e sho.d he ... wUh one . «.e s^d 
ear cusses. to evaV.ate .e,c.oh to the fo^at and.vocahuu.^ 

pilot. mstru^ent for. graduates' should he completed ,n e nv ■ 
. . The instructors' ,uestionnair. should.he completed a.d 
evaluatsdJ* Progra". nanagers by late fall. 

-^SiSr^'--- fro™ ea^ pr .r ^ • 

Should be identified, usin, a table of randc™ numbers. In late 
2. preferably around Than..ivin. a ,.estionnaire. a; person,,.ed 

'■„«eVof explanation and a self-addressed .a^ped envelope are ,^ 
- ..ed to the first fifty of these graduates. ^ 

v,.„ed.ndeliverable. an additional na.e. fro™ the l,st sHo.ld 

added to the sample. . \ ^ . u or vpIIow 

K ^ . \ u i;i Ko nrinted on pink or yenow 

, Th6 graduate questionnaireYhould be printed 0 . ^ 

^ ■ c Tf the orogram manager is someone most 

pap6r to improve returns^ .If the prog , 

^ ^ w-ith the ^personalized letter should be 
graduates come in contact with, the pers ^ ^ 

written an/signed by the program manager. ' • 

^ ■ . ^ -in late fall, between Thanks- 
A second mailiiig'should be done in late.fall, d ^ . 

w-inn the letter somewhat, and stressing . 
aiving and Christmas, varying the letter 5 , ^ 

fa reolv A third mailing should be done during r 
• the importance of a reply, a ^nir ... 



the Christmas vacation, using /the saine;Tett3r as the second mailing 
with a handwritten "request for a reply .as a postscript' to the 
letter in the sanje handwriting' as the signature. 

Identifying Four-Year Colle c^es and UniversifiP|^ - The identifi-^ 
cation of the four-year colleges or universities to be included ' \ 
.., in the studiefTshoul)(i^be,done from the graduate questionnaires ^ 
Returned. Only foVy ear colleges^or universities attelded by ien • 
percent of Ahe graduates from any specific prog^m should be in- 
^ eluded in the evaluation of that, program. The list of ivi four-year 
colleges and^ universities to be included should be completed by 
late January^ ' . , ' , 

, Personalized contacts, should be made with each four-year college 
or university to be inc^i^d in the system. For large inkitutions 
the contactis should be Hiade^Jj^eparttiehts . In the case of smaller 
institutions, these contacts may'be^made with a Dean, Vice-President 
' ^^Presidenl^ These personalized contacts should be made by ■ 
••visiting the institution. If this is not possible, a letter 
fono«/ed by a telephone contact would be appropr^'ate.' As a result J\ 
.of these contacts; the system and the use of community college w^ill 
■ make Of the results, should be explained. Further, the four-year 
coi;ege or university should be requested to explain the easiest 
method oMdentifying each flradub^e's courses and method of identifying 
instructors. If the four-year college or 'university has a computer ^ 
printout each .semester that identifies the courses in whitfh the 
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Students are^egisterea,' this should be utilized. Contact with 
each department is necessary ^to verify the instructors for - 
these courses. This should be completed by the middle of the 
sejnester^, "in order that letters and questionnaire can be mailed. • 

The letters should be mailed approximately four weeks befojjj^ 
the end"' of the quarter or just before mfd-semester if the semester 
calendar is used. These letters should briefly explain the pro- 
ject, identify the graduate by name) and social security number, 
identify the course in>hich the student is registered, and explain 
that the required permission to release information ha^ been obtained 
from the graduate as required by the Buckley Amendment. If no res- . 
porise is received from the instructor in four weeks, a second mailing 
should be done,, followed by a third mailing, two weeks later. All 
questionnaires should be collected from the University by May. 



Component Four: Evaluating. Data I v 

The Director of Follow-up should prepare an analysis' of all 



questionnaires before the end of May. This analysis should be 
descriptive and non-judgmental. By using a questioning technique 
in an accompanying memorandum, the attention of the program 
managers and faculty members ^may beTocused on paj:ticular issues. 

Graduate Data: Graduate Data should be analyzed using methods 
•^t will provide quick 'and easy reading for program managers and 
)acul\^ members. Edch section should be analyzed separately, providing 
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•th descriptive data regarding present status. ; 

ofg..duates.analys...ofcn . 

of open-ender questions. The cr.ter ^ 
. iH hP analyzed using a graphical display. 
^""'^""^ Trs rJ - analysis o, the University inst.cto.. . 

questionnaire also, shouio " ^ .h» same order , 

■ .,,Ho„..eferenced bar graph should be dra«n vn the same 0 

cnterion-rerer „„„,Hson Any comments , 

•^s that for the graduates for easy comparison. _ . 

/ . the open-ended questions should be presented. . 

yrtainin, to the open ^^.^^ , , onagers , 

andUculty should.e as.ed to reviev, t e at ^^^^ 

^ 1 this report by the middle of June. 

p„.ed and ^ "^'"^J^^ ,e encouraged to reco»er,d. 

o> these data, the program »«n,gers ^ .^^ 

^...nges in curriculum anW " , ^ 

^ ^ Aariiltv members do ^ot responu «. . ^ 
tne program onagers and ^^culty me ^ , 



the program managers anu _ , J 

request.^ secon'd request shoul<l.be sent giving . s.^ V 
,;„e. A,1.rd:requestshouldbemadeinpejsono,thoseno* 



respomTing. , y ' -W . ' he program managers 

Before the total rep(jft is completed, the pr 

. 1H be asked toVeview the instruments.and 
and faculty members should be asked . 

^ h noes for the following year. This 

^sy^rtemandtoreconmend ncngesfor _ 

^ ^ - " M rn^^stant revision of the goals, system, 

system df revifew and cof^stant 

H results is of major .importance to the success 
instruments and results is 

of the project. ^ • . * 
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Using the data from graduates, university instructors, program 
managers and facul tj^ riiembers, a total report oh each program should 
be prepared by July. This report s^hould be sent to all program 
managers and faculty members for consensus, ^ 

Component Five: Introducing Data into the Decision Making Process 

It is important to review the decision-making structure of 
v.the institjjtion in establishing this component^ All community 
college committees, department personnel^as well as administrative 
staff that is in the position to make decisions regarding programs, 
curriculum or firwnces should receive the program evaliiations. It 
is also important that'copies of the evaluation be sent to the 
University- 'administrators and instructors who participated. Unless 
the final report is widely distributed the communications network ' 
will be broken. 

The final reports should be distributed with a personalized 
memorandum reuqestirig-permission for the Director to appear before 
committees and offering to speak to individuals. Encouraging 
■individuals and committees to become jnore involved'wil 1 make v 
expansion of the program easier. * 

TJ^e final reporjt should be in Broad terms, outlining the 
participation in the report]^describing the data collected anjd. 
reporting what changes are already being implemented by the 
faculty members and- program mar^gers. This report -should also 
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describe any changes thai should be implemented at an institutional 
level as identified by' thjis research. These changes might be 
in. recruitment, catalog, ir library and resoilrc6 material • 

This entire system ana its five components contain a built-in 
revision and validation system. As long as all the people involved 
are open, honest and are not intimidated by this system, programs 
and curriculum will be receptive to the changing needs of the \ 
students and the higher education community as a whole. > 

• 1 ' ' ' • 

I ■ • . 

Summary ^ 

This major research project developed and implemented a 
system of five cpmponents for follow-up studies of Associate of 
Arts graduates. This project provides a process that can be used 
by any community college in Florida as mandated by Florida Statutes 
S230.7551 and guidelines of the State Department of Education 
6A-8.581(4). ' /^ ■ 

Using performance or competencies identified by Hi^sborough 
Community College faculty members for each program, /the per- 
ceptions of graduates and university instructors as to the graduates 
academic preparation were analyzed. 

The system design contains a self-correcting mechanism 
of feedback and revision for each of the five components as well 
as, the entire system.' Therefore, the facilitation of this system 
is not required to make judgmental decisions regarding the adequacy 
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of the program goals ,as sUted in performance or competencies. 
However, the facilitation is required to point out facts that 
emerge as a result of the data if the^ program managers or faculty 
members do not apbear to be acting on the data received, > 
^ This system is built on participating management and a pilot 
project .must enlist the ajd of prdgram managers and faculty members 
willing to c^perate. \^ After the initial project, if the parti- 
cipation, is voluntary,a|nd the project successful, expansion ^ 

■ i . ■ ■ ■ ' 

of the system will be considered part of institutional research 

and will be anticipated by prpgram managers and faculty members 
alike. ; ^ 

The resuHs of the implementatior( of this system. at 
Hillsborough Community College were, frgitftrl curriculum re- 
vision suggestions for each program which were implemented. The 
decision makers received the data with interest and encouraged v 
the progra;:! managers and faculty members to implemisnt and $ug-» 
gested revi^Totvs.' The system, questionnaire and goal revisions 

suggested by the faculty arid program managers were adopted and ' 

* ^^^^^^^ * 

impl eniented . , 
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APPENDIX A 




Dear , 

As a graduate from Hillsborough Community College in the pre- 
teaching curricuJvn^* ypiJ are more keenly aware of the need for 
evaluation of educational programs. To assist , Hill sbprough 
Community College in fulfilling this ^oal, would you complete . 
this questionnaire and return it in the enclosed self-addressed 
stamped envelope. . 

Any further coijunents you care to make will be appreciated. These 
comments can be made on the back of the questionnaire. 
• * '' ■ ' ^ 

Sincie it is human nature to procrastinate in completing question- 
naires, your immediate attention would' be greatly, appreci^'ied. 

Sincerely, ■ ^ 



Patricia Louise Gill ^ 
Assistant Director 
Placement and Follow-up 

PLG:lss 




APPENDIX .A CONTINUEr ^ ./ ' 



November: 25, 1374 



• : -v. : ^ • ^ • .. 

• • .• . . ^' ■ ■ ■ . ' ■ ■ ' 

Dear ' - . ^ . • \. \ ■ 

It is very important to present Hillsborough Community College • 
students that the graduates chosen to participate' in Hillsborough 
Community C(jH^ie fpl low-up project respond to the enclosed 
questionnaire. National -studies i«dicdte^ the most reliable 
source of information about transfer -program are grtuduates from 
that progranj. . 

If you would like to make artS^ comments or ask any questions 
please feel free to call my ofWce Monday through Friday, 8:30- 
5:00* Your cooperation is greatly appreciated. 



Sincerely, 



Patricia Louise Gfll 
Assistant Director 
Placement and Follow-up 



PLG:bjc 
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APPENDIX B 



Dear 



A pilot, project to begin-to implement Florida State Guil dines . 
6A-8.581C4) has begun at Hillsbprough Community college^ As part 
of this project, Hil'j^^rough Community College is conducting 
follpwtJup studles^on^p grSKluatft during 1974-75, 

^ . ' ^ has identified you as one. 

af their instructors or their advisor, and in this capacity woula 
you complete the enclosed questionnaire. . 

The state guildelinds indicate that follow-up studies should be 
conducted using performance or competency based terms. Therefore, 
the' questionnaire has been designed to obtain your preceptions of 
the students success in achieving the stated goals of their two 
year A.A. prograirt. The results 'of this study will be made avail- 
able to you. 

Thank you for, your cooperation. 
Sincerely^ - . 



Patricia LouisQ Gill \ 
Associate Director 
Placement and Fol^w-up 
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- . ^ APPENDIX C ' 

HIkLSBQROUGFf COMMUNITY COLLEGE r 1975 ^ • 

Pre-Teaching Program Goals / . , . 

1. ,The graduate wilT dem(Jnstrate ability to commurvicate effectively, 

both in writing 'and speaking./. , ^ ^ ' r 

2. This graduate v/ill^ exhibit critical and lexical thinking "in ^ 
evaluating given information. ' ' ^ y 

i^>--The graduate will be able to identify the effects of ethnic 'df. 
culture on ind"|p^idual development both from a historic and 
present day view and demonstrate this by improving interpersonal 

" relations. - ^ / - 

/ 

■• / 
4* The graduate will relate daily political , social , and economic ^ 
events to patterns of past historical incident's for the^purpose 
of making decisions in their personal life, /" 

S? The graduate will demonstrate an abilitj' to inteii[)r0t scientific 
facts and -their implications to future*" hilfhan development for the 
^ purpose of making personal and economic decisions/ 

' ' . " * ' • / 

6. The qr^uate will demonstrate basic mathematical skills by solving 
problems and interpfetating graphical data. / 

' . . ' ■ ' i ' ^ ' 

7. The graduate will demonstrate a better under sta^nding of self ty 
establishing personal goals, improving ij^terpersonal relationsl^ips 
and accepting .individual differences. 



1 

8. The graduate will develop his or her own, value system regarding art 
and art forms and demonstrate this by attending chosen presentations. 
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^ APP^NDix C CONTINUED ' ' f 

\ ^ • '■ . - ■• 

\ Hill sboroiigh Community College 1975 . . ' 

Pre-Buslness Administration )>ro gram Goals / <^ 

1^ The graduate wfTl demonstrate ability to communicate effectively 
' in. writing. . 

Z: Th^ graduate^ will demonstrate aj)ility to use rpathematjial formulas 
An solving and interpretation of data related to busiips", ^( ^ 

3. The graduate Will be able to apply statistical methtodoTogju'td. !^ 
• basic business- problems. 

; ■ . ^ ■ , ' • ■ 

4. The graduate will |)e able to interpret 'scientific facts and the 
implications of the role of scientifiodata to future personal and 

^ ; human development. 

5. The graduate will evaluate the use of data p4^cessing systems in. ' 
business ahd deriionstrate this by presenting adequate information 
to a computer programmer to facilitate the solving of starjd^rd 
business accounting problems. . « 

.6. The graduate will be able to Evaluate the area of national ecpnomics 
In relation to banking systems, international trade and governmental 
policies. 

7. The graduate will be able to identify the effect of culture dn in- 
dividual development, both from a historic and present day view, 
and recognize forces which motivate interpersonal development. 

8. The gradliate will be able to demonsrate good management policies . 
by relating individual management objective to company goals. 

9. The graduate will be able to set up and implement an accounting 
^stem f&r a small business of 10 million dollars or less per year, 
or a standard accounting system for a braiich office of a larger 
business. T • 

10. The graduate will understand (he theory and logic of good accounting 
procedures and demonstrate this by recording properly, business 

* transactions. 

11. The graduate will be able to demonstrate managerial control in an 
accounting system by implementing cost analysis to products and 
services. - 
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APPENDIX C CONTINUED 



* . 

Hillsborough Community College 
Pre-P/6lice Science, Program Opals 
. 1975. 



ERIC 



!• The graduate will demonstrate ability to communicate e-gfectrtvely, 
both in writing and speaking using the vocabulary^nd^ style^ 
necessary in police work, 
' ' ^ " ^ . ' . ' i 

2. The gradua^te will be able to conduct aiL investigation ahd \ ' 
demonstrate this by accurate, notes, skwches and reports, 

3-- The graduate wTll be able* to apply the scientific method in the 
co|^^lection, identification and presentation ta-f the evidenceHo- 
a police investigation. \ * 

. 4v The graduate will be able to utilise his/her knowledge of 

criminal justice agencies and the court system in solving . 
^ daily problems in police Work. 

5. The graduate will be able to classify crimfesl 

■ ■ ■ ' ■ ' ' . ^ • ' ' ■ ; . j: . ■ , 

6. The ^graduate will/be able to describe the basic capabilities 
and services that may be prbvided by a crime laboratory, 

7. The^graduate will demonstrate understanding of the^ U.S. Supreme 
Courts decision relating to the pverall operation of the. Law 
enfocement agencies. ^ - , ^ 

8. The graduate will be able to describe managerial and administrative 
principles involved in traffic enforcement and education. 

9. The graduate will be able to demonstrate an understanding of the 
manageqient and operational functions, role and facilities of a 
police department. 

10. The graduate will develop a better understanding of self and ^ 
demonstrate this through improving interpersonal relatipns 
and acceptance of individual differences. 

.■ , • ' ■ 

11. The graduate will be able to identify the effect of culture on 
individual development both from a historic an4 present day 
view and relafe'thls information to daily police work. 

12. The graduate will demonstrate basic mathematical skills in problem 
solving and inteprefttion of datsi. 
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, ^ : ' APPENDIX D 

HILLSBOROUGH COMMUNITY COLLEGE 

Pre-Teachi ri^*- Graduate Survey. ^ 



. Name ^ . ' ' Address 



Zip 



1. Are you attending college: Full-time ( ) Part-time ( ) 
Nc-C ) Major Aren 

2* Wh^_cdfiege are you 'attending? ' L/_ ^ 

it' 

3. If employed: Is employment related to H.C.C. degree? " 

. Yes ( ) No ( ' ) . Where? ■ . -.. • ■ 
-Supervisor 

4. Did you attend H.C.C.; day ( ) - evening (- .) 
weekend 4:ol lege (' ) 

5. May we ^nd a si^hilar questionnaire to your university^ 
Instructors? Yes ( ) No ( ) 



Did youA cormimity cottzgz p/iogAam pKzpa/iz. you to:. 

To Some 

Yes Extent Poorly No 



a) fcu^cte adtquattty to mzzt^ ( j ( ) " ' ( ) ( ) 
aZt thz Ae^tuAJimzyvts at 

tht {JualvQMity ttvzZp Z.z. * _ 

toAm papMJb, ixam^, and ^ ' ^ ' 

60 on? " " - % 

b) -otteAp/te^ iact6 and _ ( ') ( ) I ) A ) 
opinions objzct^veZy? 

q] expA,w4 youAMoZi oMZZy ( ) (') i ) { ) 

botk AJi cJba^^ and to pecA 

d) 6olvz ptjoblom^^w^ki ( ) ( ) { \ ( ) 

KzqvuJit nmviiciat \ 
' ^irvteAp^zXation^? 
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.APPENDIX CONTINUED 

• ' ■ A ^ • ^ ■ 

e) evotaote data p^z6zntzd^ { 1 
^ -cn gnapkicaZ ^om? A 

jj) X^jtzA^t^ lndi\fif^^^ mo { ) 

have been ^hapzd by a ' 

g) AAzntL{y ihz K^!£aXxori6ltlp ( ) 
be^ftceen g^up cat<a/te and thz 
dzveZopmznt oi cixZtu/iz' and 

IndLbjidixat' ptuonaJUXfff . 

h] ancLLyzz cuMznt zvznt6 and { ] \ 
zvaJLuatz thti/i zHzxJ^ on 
youA pojuomZ io^loAz? 

I) 6otvf: pwbZm& MJbig * { ) < 
cJiitUiaJi and ZogicaZ tkiniuhg? 

j] zvaluatz thz z^^zctlvznze^A i ) 
In itylz and iom oi thz ^ 
vanJittij o^oAt ^oniM i/ohldt 
AuAAound Mu? ift 

^. ' . * ■ 

fej zvaZujoutz ihz ^actJS dznlvzd { ] 
i^Mom 6 dentine invii>tigation6 ' " 
and KzJbitz ikojn tx> iktVi 
AjnpticcuUon^ on human! (jozl^akz? 

Z] Axlzntliff Apzciilc JfuMtoKiz ( ) 
actioM vokcch heJLp io 6kapz 
;thz voOAJLd^day? 

Kzcjognizz thz (JoA.ee4 (/olu0i ( ) 
motlvatz ^ot£ and XniM^cz"'^ 
youA ^ntz/LpzMomZ KeZat<S)nAkcp6? 

nj to uAe thz tSbKOJty and:avtd^ { ) 
/ cataZog to tocatz nzzdzd 
Jtzizn.znce^? 

o) to u6e peAxadUaZ Indzxu? { ) 

w . - • \ 
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APPENDIX D CONTINUED 



1.. Whii^oyrse or courses in the pre-teaching pragram did 
yoiT find most valuable? Why? __j , 



2. Which course -or courses did,you fi^d l«ist valuable in 
your pre-teaching progr*am? Why? • ^ 




3. What would you substitute? 



\ 



4; Did you find the learning resources facilities adequate 
at H.C.C.?f Yes ( ) No ( ) . 

5. While^oy weref at H.C.C, did you avail yourafilf of the 

serv^^s of fered by the counseling staff? YeVt ) No (' ) 



Did youA H.C.C. Couniatojg itcL^m 

1\ <U6^t you in .making 
K6(Utablz post gmduatLon 
p£an&? 



Yes 

4 . 



{ ) 



To Some 
Extent 



) 



( ) 



( 1 



2* heZp you lejoAn to makz- 
, pu>ductivz decx6^a6 ? 

3m ftuxki you auia/LZ di 

atteJuiativz co/tecA pos/^ihitit^z^? ^ 

4. 'nzizfi you tQ othoA appHjo^ ( ) . 
pfuxvtz sountz^ oi in{[oHjmtian? 

e ■ * ' 

■ '*i ■" 

5, ijipwducz you to otheA ( ) 
62AvicQ/^ dvcuJLabtz to studzntA 
6uch afi: 

^. 

a) JUbKoJiy & IzoAning laboAjcutoAy 

b) '^^ouinciii^ aid . * 

c) job plac2mznt 

d) ^tudznt govzn,mznt 

e) social organizations 

6. . a^6i6t you in Azgistzning? I ] 

7. zvaZuatz thz ptacejnznt { ) 
teAtA ^or pnjopz/L aaidmLc Zzvzt? 



)or1y 

i ) 

f ■ 

{ ) 



NO M'l'm 



( I 




f ) 
i ) 



I*) 
{ } 



( } 
(■ ) 
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RPPENDI^ D CONTINUED , € - 

Hmsborough^tommunity College -1 
■Pre-Business Administration Graduate Survey ^ 



NAME \ ' . " . ADDRESS 




— — ■■ — — — ^ - V 

1- Al^^you attending college? Full-time ( ) Part-time ( J 
10 ( ) Major Area ^ ; 

2. What college are you alJtending? 



3. If employed:- Is employm^t related to iH.C.c/ degree? 
Yes ( ) No ( ) Where? ' 1 Supervisor 

4. May we send a simila#^questionaire to y»tlr university * 
instructors? Yes Qf, ) No ( ) 

•/ . " ■ 

Signature . . . ■ ■ ' _< . 




5* Vld you/L ?A,z--Bi)s^inz66 AdmiyU^t/iotlvz piOQHxm at H.C.C. 
p^t^f^z you tp: . ^ 



\To Some. 
Yes Extent Piporly No 

a) mzzt iht mlttzn ojom- J, ( ) ( ) • ( ) ' ( ) 

ojt th^ urUvzuJXy tzveZ? ^ 

fa)' 4e^//«/ie njatfeema;tcc6 ^ (' ) { '). ; ( ) it) 

. pnog/um? \ . 

e) apply 6tatl6tLc^ fa(u\c ( ) . /( O ( ) . ( ) 

'fau6^e6^ p/tofa£em6l 

d) evoeuate ^aotA de/tAed ( ) ^ ( ) . ( ). ( ) 

and ^ttato. thm to thoAA 
Ajonpticatioyu^ on human voeZ^oAz? 



e) ductus ihz u^t oi a , { ] T ) ( 1 ( ) 

CJomputQA to 4^olv(L bu^inu^ pAobt^m 
uUth computtfi pHognajmoJU and otiizA faaA>cnW4 6tJudzYvU1 
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APPENDIX D CONTINUED 



\ 

k] dzmori&tnjcutz good aczoLUfvUng ( j) t ) ' ^ ( ) (J 

I) calciUatz co6t ayutty6l&\ ( J (0 ( ) 1 ) 

0^ pnjodattA and 6eAv^eA? 

m) to uAe thz MJbAjOAy and > i ] ^ [ ] ( ) ( ) 

coAd QjotaZoQ to Zocatz '' f^ ) ' 
mzdod AzieAQ,ncit6? ■' ( * 

>i) ^;Co a6e poAApdlail ^ndixu ( ) ( ) " ( ) f ) 

to locatz in^o^uiuvUon? . ; 

What coflrse or courses in the Prl-Busiriess Administration area 
did you find most valuable? 



i) zvaluatz 'thz yiat^yial_ {,) ' (,) (), () 

zcoyiomic^ in /leZation to . ' , ' , ' 

g] tol^Aotz IndlvidixjodU tjoko . . ( ) ^ [ ) ^ { ] . ( ) 
^ havz bzzn 6hapzd by arOwtizty " \ ' . ^ 

^ 0^ AmeAA^n cuZti^ - /' 

, « ' ' >' ' .. 

h) hzZp to %z<iogYiizz^tkz ioKzu ( ) ' ^ ( ) [ ) ' ( ) 
' MlUch motlvatz yoa 'andin^Zazncz^ 

youJi int2ApzA^onat K2J^^ 

I) zvaZjikitz ^o^ goaJU avid A ) '( ) ' ( } 
dAj^play a ^tijl^^ 

in kzzpin^uUth tkuz goaZi? ' - - ^ 



jy to up and impZmzrit ( ) , ' ( ) ( ) ( ) 

an^a/iojoimting, 6y6tzm {^OK a 
6maZl bu6inU6? 



Why; ^ \ ; ^ 

Jrfhich coorse or courses in the Pre-Business Administration area 
prQvided you with the least amount of useful information? 
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APPENDIX D CONTIiilUED . ' 



What type of course would you substitute forv the above? 




Did you find that the resources ^^^vaiJI^r^ in the library and 
learning laboratory provided the materials necesslary for your 
studies? Yes ( J. No ( ) i 

What changes would you recommend? * . ^ . 



To Some^ 
Yes "txtent 





- pJbm? 

2. /ie|p yo(^^aAn to makz ( ) ( ) ( ) ■ ( ) 

3. . mofee you am/io. oi ( ) ( ) ( ) { ) 

AJfi^o Amotion? 

5. IntAoducz you to othoji ( ) ( ) ( ) ( ) 
6QA\}i(iu avattablz to 

6tudtnt6 ^ach a6: , 

a) tlbKoxy 6 IzoA-yibiQ laboHjoutjoKy 

b) ilmncZaZ old ' ' 
* ' c) job placment ' " ^ 

d) 6tud^nt goveA.mznt . • 

^e) 60(UaZ oAgccnizatioyU ^ ' 

6. (U6l6t yOll In KQjQl^ttflUlQ? ( ) ( ) ( ) / ( ) 

zsxxZixatz thz ptaamznt ( ) ( ) - (J* ^ (J 

-tw-tA ^OA pnx)pvi acxidemla 

IcvzZ? 
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DCONTINlfED 

HILLSBOROUGH COMMUNITY COLtEGE 
Pre-Police Science - Graduate Su 



NAME . ADDRESS ~ / ZIP 




1. Are you attending college? Full-tim& ( . ) Part-timaf( ) 
No^(* ) Major Area ' . . ' " 

2. Are you intending to pursue a career in the'area of criminal 
, , justice when you complete college? Yes ( ' ) No ( _ ) . 

3. What college are you attendingf - \ . > ' 



4. If employed: Is employment related to B,C-C- degree? 
Yes ( ) , No ( ) 

Where? . ' Supervisor " 



Did ifou/L aomnumitff coZZzgz pnjOQnjm pKzpcuiz yoa to: 
* ^xTo Some ' 

^ Yes Extent Poorly No 

a) umXtz adtqjjjcuteZy to mzt { ] Ji ) ( ) / ( 1 
citt tiie. A,e.qijUAmznt6 'at ^ fl 

tht OMJOVuity Z.z. 
tznm papzu, zxam aifid 60 on? 

b) comuyUcatz z££zctivzZy? 

c) u^z tht vo.cabulcinxf md ( ) ( ) ^ ( | , ( J 
mnk and cjoixuti^? 

d) 4Jit2ApKzt iaxit6 and opinion6{ ) ( ) ( ) ( ) 
pbj^cZLveZy? - 

e) exp^e64 yoaueZi oAoZZy f ) ( ) " [ ) ^ ' ( ) 
both in cZa66 arid to pzoA 

0 6oZvz pnobZm6 vokcch ( ) { ) ( J ( ) 
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£] 6oZvz p^obtzm f^jhldi ( ) ( ) 

3 ) ' *eua£aate dcuta p/tu ZYVtzd { ) (J. 
^ >6i gAaphicaZ £6nm? /^v- . 

/laue been 4^kapzdyhy\v/^^ 

d£ AmeAicSan <ixjJ^^axA^^ - 

youJi kniMtzdgA to potai^sff^^i^ 

Ji) JidzYitLiy tht n^2ZaXA.aiys^1r^^ ) ( ) 

r > fae/Ctceen g^up cuttank ^jik . 
.^e deuelopmen^ oi( a .cottar 
V and onz'6 ^indLvldmZ pcMomtLty? , . 

y) anaZyzz.iinAznt events? and ( ) ( ) 

potLcz u)o/ik7 • . ' 

fe) (jutitLzz you/L fmofA>Zzdgz oi { ) i ) 

cAyiminaZ /oA^ce agejac/CW.. . 
(and tkz coujvt 6y6tm to 
6otvz p^bZzm In potLcz ' 

/ ■ r 

£) a»9p-£{/ thz 6(iizntiiAXL mopiod [ ) ( ) 

in-iuptoiining on, coZZzcting 
- ;C/ie £a<it& nzcz&taAjj aji a 
' poZicz AJivutLgaZion? 

m] zxpZaZn thz-QVQAoZt :r-yv( } ( ) 

opznjatibn o£ Zm zn^on^czmznt 
agzndiz^ cu^ tkzy n^zZatz to 
' U.S. Supreme Count d^cl6ton6? 

n) \^zxpZcUn tkz mdnagzmznt nnd ( ) ( )' 

opoAationaZ imcZioru, itoJbt 
sond iaaJJUXlu qi a poZicz^ 
. Ai^mAtmznt? 

o) dz6CAtbz tkz cjipabtZx^ ( ) ( ) 

. and 6ZA,vicz6 that can bz 
pno\)id2ji by a poZtaz Zabonaton^y? 

p] dz6cnMiz zn£on,azmznt and Ji ,) ( ) 

zducxvUon n^zqiuAtd tn tAa^£4.c^ zn^onazmznt? 
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^ifCUik motivatz you and 



( ) { ] . { .) { ) 



K] . to U6Z thz JUb^y and { ) /( ) • iJ r (J 
coAd aitatqg to Zocjatz nzzded 

-6) to tJL^(i::^&Ujod^ J . { J (J (J 

1. What course' or courses in the police science program did 
you ' f i nd most val-uabl e? Why? . ■ . ' ■ 



1 



2. Which 6ourse shoullNie o)nitted from the police science 
program? u,- . f-: , Why? ■ - 



3, What would you substitute? 



4. While you were at H.C.C., did you a^ail yourself of the 

• services offered by the counseling. staff? Yes ( •) No ( ) 

5. Did ' 
at' 



id . you find the learning resourcjes *facilities:;lEdequatfe . 
:'H:c.C:? Yes ( )^No ( yt!';'''^^^"'-.^ • 



6. Do/yoa plan to attend a Police Standard. Training or other 
sefcinar in the near future? Yes ( ) No ( ) . , 

Did yojjJL HXX/ (loujn^eZtng 6td^£: ■/ 

' To Some ^ • 

Yes ^ Extent Poorly No 

K (U6Ut yoii in jJSfeoi^; . ( J ( J ( T ( } 

laitabtz pd6t gnaduoMcon 

pZan&? \" - , ; 

2* hzZp you JUciAn to. makz "{):'() ( ) \ \ 

pnjodaijxvi dici&ion6? . * ; 

3. makt you am/imm {\] (vj A ) J 

• aJUzhnativz aaj!^li po66i^ , 
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APPENDIX £ 



■ Dear . ■ 

As more and more students are transferring from community colleges 
and universities, the state mandifted follow-up program Is becoming 
a-'reality. Hillsborough Community College has begun a pilot project 
to implement State Guildelines to evarluate graduates in. performance 
or competency based terms. qo ' • 

^ • ' ^ • , '• ■ has been 

identified as a student in ' • - ' . ■ " • during' 

the Winter quarter of 1975.' As the instructor of this course-,' wc- Id 
you^ complete the enclosed student evaluation and return it as soor. as 
possible. " 

Thank you for your c(W)perati on. ' < 

... ■■, . 

Sincerely, > 



Patrlciia Louise Gill, > . 
-Associate Director q 
Placement «nd Follow-up 

PLG:lss * 
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APPENDIX fT' • 



HILLSBOROUGH COMMUNITY C'OLLEGE 
TAMPA, FLORIDA 



MEMORANDUM 



TO: 



Attached Distribution Li.st 



FROM: 



Patricia Gill 



DATE: 



May 12, 1975 



SUBJECTriPRE-TEACHING EVALUATION 1973-74 GRADUATES 



The pilot project to evaluate graduates from this program has 
been completed: the data was collected using a random sample of 
thirty 1974 graduates of which 23 or 76 percent of the sample 
answered. The questionnaire of the University of South Florida 
instructors, who were requested to complete the questionnaire, 
22 or 76 percent returned the questionnaire, while only 20 or 
68 percent weie able to^omplete the questionnaire. 

The\ results of these questionnaires were evaluated by HiTlsboroi-'gh 
Community College program managers and faculty. The curricuTujn areas 
considered important to re-examine were Mathematics and Introduction 
to Education. Mathematics" rated low on both the university instructors 
questionnaire and graduate questionnaire. Although, this would be an 
.indication of need for examination, the required courses in this area 
have been reorganized in 1974-75 and the results of the next follow- 
up study should indicate the next step.. 

The graduates felt that the courses in Introduction to Education 
and Educational Psychology were so similar as not be be advantageous. 
Suggestions made by Hillsborough Community College faculty were to 
(a) Review the course outlines (b) consider revising the course out- 
line' where duplication seems evident (c) closer supervision«of part- 
time faculty In the area. - * . 

While the Instructors atllniversity of South Florida felt 
Hillsborough Conmiunity College graduates were prepared to undertake 
the academic requirements of university work, they, as well as '■" ■ 
Hillsborough Community College program managers, felt the Pre-Teaching. 
program should state Pre-Elementary teaching J 

* 

I would like to thank each; and every one of you for' the assistance 
you gave the Follow-up office at all stages of this evaluation. 

* « 



124 




APPENDIX F CONTINUED, ' ^ 

. 9 ■ 

cn 

HILLSBOROUGH COMMUNITY COLLEGE ^ 



- TAMPA. FLORIDA 

MEMORANPUM 



TO: Attached Distribution li&t 

FROM: Patricia Gill 

DATE: lAay 12, 1975 > ^ V ; 

SUBJECT: PRE-BUSINESS ADMINISTRA^ON EVALUATION .1973-74 GRADUATES 

The pilot project to evaluate graduates from this program has 
been completed. The data was/collected using a random sample of 
thirty 1974 graduates of which 26 or 86 percent of the sample answered 
the questionnaire. Of t||B 15 University of South Florida instructors, 
who were. requested to>complete the questionnaire, 13 or 86 percent 
returned the questionnaire; while only 10 or 66 were able to complete 
the questionnaire. 

The instructors at University of South Florida felt . the graduaias 
viere pre^red to undertake the academic requirements of university \.zrk. 
'The graddate indicated they could not discuss adequately the use of zhe 
computer in business. , * . 

A curriculum revisions supported by faculty and graduates was 
r^^tlip addition of more Mathematics. It was suggested that closer 
^evaluation of the program to which' the graduate transfers be ^made 
in order to further evaluate this finding. Twenty-five (25) percen: 
of the graduates responding, indicated a need for increased library 
reference material. 

I would like to thank each and every one of^you for the assis: 
ance you gave the Follow-up office at all stages in this evaluation. 
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APPENDIX F CONTINUED 



HILLSBOROUGH COMMUNITY COLLEGE' 
. TAMPA. FLORIDA 



MEMORANDUM 



TO: . 



Attached distribution List 



FROM: 



Patricia Gill 



SUBJECT: 



DATE: 




C 



The pilot project to evaluate the 1973-74 graduates from\this 
program has been completed. The data was collected using random , 
sample of 30 graduates of ^^which 22 .graduates or 7355 of tNr sample 
returned the questionnaire. Although the responses were not as vgocc 
as we had hoped, the data was sufficient to Indicate some revisions 
to the questionnaire and supported some curriculum revisions alreacy 
in the process of being implemented. 



The graduate questionnaire^ will be revised before the 1975-76 
sj:udy Is begun to evaluate graduates present , career goals, and 
include the ^valuation of support services. 

^ There Is a need to Identify the final career goals of H.C.C. 
graduates from the program. While 59% (Sf these graduate('s are 
attending!' university In criminal justice area* 72% of the graduates 
are attending university and may have a final career goal In the 
criminal justice area. Counseling can also assist in recruiting . 
for this program, as at the mwnent this sample shows only 9% of 
the graduates are women, while the field is becoming more and more 
acceptable as a field for women. 

The curriclilum revisions supported by faculty and graduates 
were addition of courses in: traffic enforcement, prison systems, 
laboratory procedures,' and bourt case evaluation. Two of these 
are being Implemented in 1974-75 academic year Traffic Enforcement - 
.and Legal Rights of Prisoners, while two ?ire already in the planning, 
stage, increased laboratory work ancf a course in the evaluation 
of court cases. " ' * 
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Of tte 45% of the graduates attending UvS.F. in the, area of 
criminal justice, the university faculty fe^fthat $hey wer^ all 
prepared for a four-year college or university, "there wasysome 
indication that -the area of mathematics needi to be examined, 
but no conclusive results canlbe drawn from this ismall s|p|ple. 

I would like to thank e|ch and every one of you fijr^the 
assi stance' yoii gave the foJTpw-up offfice at all stages in , this 
evaluation. We hope to increase our 1975*76 returns. 
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X ■ . ■ T 

These are excellent'. Suggest you recommend that the 
academic affairs council work closely with Progranr^Coordinators. 
for ev.aluate results of survey and make necessary recommendations 
for changes etc. deemed necessary. 

Bin T. 



J. 
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HILLSBOROUGH COMMUNITY COLLEGE 
TAMPA, FLORIDA 



MEMORANDUM 



TO: Ms. Pat Gill 

FROM: . Ray Entenman 

DATE: May ^1,1975 

SUBJECT: PROGRAM EVALUATION 1974 



I. haveVeviewed the program evaluations which you submitted,, 
and have the following coimfents: 

Pre-Business. Administration 

The addition in Mathematics has been^^ discussed wf th 'the 
Academic Affairs Council, and is under revision for iresubmlsslon 
to .that group, , ' 

Pre-Teaching 

^ The content outlines of Introduction to Education and 
Educational Psychology differ significantly; .it would appear 
to me that the overlap may derive from teaching methods employed. 

I do not understand the suggestion that this program 
should be designated Pre-Elementary teaching, since the 
curriculum is a broad foundational approach with little emphasis 
on any specific teaching jnethods. Where would the secondary 
or college teaching student begin? 

I would be Interested and anxious to share more detailed Infcnna 
tion on the response information as it Is made available. • • 

RE;ed , 

ccv W. Tripp -^'^ ' ■ ■' . 

E. Mattson 

Dr. D. Ferreira lOQ 

• S, Rampello. V. , 
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HILLSBOROUGH COMMUNITY COLLEGE 
TAMPA. FLORIDA 



MEMORANDUM 

TO: Pat Gill ; 

FROM: Sam RampelTo 
DATE: May 19. 197S 
SUBJECT: PROGRAM EVALUATIONS 



Pat, thank you for the information^ concerning program evaluation 1974. 
I read all of them with interest and plan to do following things 
to meet some of the needs which were indicated in your memo. 

1. a. I Intend to have Mr. Joe Rodeiro meet with the pre-^ 
^ business administration faculty to discuss the need for 
Increased library reference material. 



b. To review the curriculum and perhaps give greater emphasis 
to the^ impact of the computer in business, 

2. a. I am most concerned that both in the pre^teachlng evaluation 

and'the pre- police science evaluation that the area of 
mathematics seemed to be deficient in the eyes of the . 
. graduates. I will discuss this with Mr. Rodeior and pps- ^ 
c sibly a conference of all mathematics teachers can be held 
at a mutually acceptable time and location. I will strongly 
recomnend that you would be invited to this meeting along 
with Mr. Entenman, Joe' Rodeiro, and myself to see if we can 
address some of the problems which your survey has brought 
to light. Sime mention has been made about part-time 
faculty, it might also be advisable that Henry Bel tran 
' and other administrators connected with part-time faculty 
also be invited to attend. 

. ' • . • . ' " ^ 

3. \ a. I concur wholeheatedly that more women should be recruited- 

• \and counseled for the police science program. I will 
, relate this ^infiotmation to Joe Rodeiro and ask him to work 
with Bill Strawn so that we might be able to increase the 
number of w6men students in the police science area. 

Once again th^ik you for this very valuable information. I hope that we 
can make some /positive adjustments^ as a result of your study. 

SR/tr . • 

xc: Dr. Seeker, Joe Rodeiro, Henry Beltran, Bill Strawn t Ray Entenman 
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. APPENDIX H • 

Time Table for Follow-up Graduate 
Evaluation System 

Fall ^. i 

y (1) mgrara managers and University personnel, inforraation 



)ntacts fliefde. 

. (2) #aduate and University instructors' questionnaires pre- " 
pared^evaluated and revised. 

■■ - ■ , " ' ■ . ■ ; 

. Nf^ember 1st - Graduate questionnaire mailed representing 
'* ^ g)E|iduates of the previous year. 

^4) CegemBer (early) - 2nd graduate mailing. 

(5) MceAer (late)^- 3rd graduate mailing. 

-A S- 
Winter ^ t . • 

0 1 ) January - Identi fy ptduates . ^Uhf versi ty i hstructors . 

y^^t^y ^^^^^ - F^»•st mailing of questionnaires to 
wjivefsity faculty. ! 



y/'^(3) WSrch (early) - Graduate analysis prepared for Hillsborough 
,^ Commumty College faculty. , - 

Sp^nlP ' • ' ' ■ " ' ' - , 

(IJ April {early) - 2nd mailing to University instructors. 

(2) ' April (Tate) - 3rd mailing to. University instructors. 

(3) May (early) - Report of University instructors' responses 
sent to Hillsborough Community College faculty. 

(4) May (late) - Total report prepared for Hillsborough Community 
college administrators, program managers and faculty; 
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APPENDIX H CONTINUED 



(5) May (late) Ndw programs to be eValuated program goal 
presented to Academic Affairs .Council for consensus. 



Summer 



(r) New questionnaires prepared. 

(2) Second round of questionnaires revised and prepared. 
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